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ABSTRACT 


This experiment was designed to determine whether 
pere was a natural association of color and pitch that 
was common among military officers of three nationalities. 
Fifty military officers were used as subjects. The 
analysis of experimental data was to produce additional 
evidence for information display design employing the 
senses of audition and vision in presenting redundant 
information. The data analysis indicated that the amount 
of transmitted information was less than one bit when the 
maximum possible was 2.32 bits. Three was a significant 
difference in the amount of transmitted information per 
nationality though no learning trends among nationalities 
were observed. The Korean subjects' average number of 
petals) EOuCrPeer1on was significantly different from the 
Americans' but not from the Indonesians'. A significant 
association of selected color combinations and tones 


existed for the Indonesian and American subjects. 
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I. INTRODUCTION 


This experiment was designed to determine whether there 
was a natural association of color and pitch that was 
common among military officers of three nationalities. The 
experimental parameters were selected on the basis of human 
factors design Criteria and the coding dimensions of audi- 
tion and vision used in previous investigations. The 
analysis of experimental data was to provide additional 
evidence for information display design employing sensory 
modes of vision and audition in presenting redundant 
information. 

The development of hardware and software technology, 
providing color graphics and computerized data displays, 
has placed additional burdens on operating personnel in 
receiving and correctly interpreting information. Opera- 
tors and information display systems must function in 
harmony, but they often exist in an environment where 
penalties for wrong decisions are Significant and perform- 
ance consistency and safety are paramount. Sensory dimen- 
Sions may be combined with redundant information coding 
in order to maintain operator efficiency and alertness. 

This investigation was undertaken to explore the 
feasibility of combining a natural association of color 
and pitch with present man-machine signal design criteria 


in order to improve operator behavior and efficiency. 
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Several references cited in the bibliography provide a 
base, sehough nonexhaustive, survey of investigative tests 
in this area. Sufficient experimental evidence indicates 
that there exists among children and adults a particular 
pattern of association of high- and low- pitched tones 
with light and dark hues, respectively. In addition, the 
experiment was to determine the amount of learning and 
information transmitted in the cross-modality matching and 
to ascertain whether these criteria were Significantly 


affected by nationality. 
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TRAS SOCIATION OF LIGHT AND" SOUND 


A. GENERAL 

There is a substantial amount of experimental literature 
investigating the association and psychological correspon- 
dences of light and sound. Marks (1974) discussed the 
equivalence of the psychological ee Or light and 
Sound, i.e., the extent to which the visual dimensions 
translate into auditory dimensions and vice versa, and 
presented a brief historical synopsis of several experi- 
mental conclusions related to the cross-modality matching 
of light and sound. He noted that the two fundamental 
attributes of sense perception were subjective quality and 
intensity. The dimension of quality was considered to be 
represented by hue in vision and pitch in hearing. The 
dimension of intensity was represented by brightness in 
vision and loudness in hearing. The correlation between 
brightness and loudness and hue and pitch had been substan- 
tiated and found to be consistent and reliable (Simpson, 
Quinn & Ausubel, 1956; J. C. Stevens & Marks, 1965; Marks 
& J. C. Stevens, 1966). Marks (1974) investigated the 
cross-correlation between visual brightness and auditory 
pitch and reported the following results: the Subjects (Ss) 
matched pure tones to gray surfaces (using the Munsell 
System values); with loudness constant, the Ss mapped 


increasing pitch to increasing surface brightness and with 
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pitch constant, most Ss matched increasing loudness to 
increasing brightness while some matched increasing loudness 
to increasing darkness. Wicker (1968) conducted experiments 
to determine hypothesized perceptual alignments of selected 
auditory and visual dimensions. Several perceptual align- 
ments were obtained; however, the alignments of pitch- 
Saturation, loudness-brightness and loudness-darkness, as 
witnessed in other studies, did not occur. In addition, 
earlier studies of visual and auditory synesthesia produced 
similar cross-correlations of brightness and pitch. 
Synesthesia was considered the phenomena in which stimuli 
reacted to by only one kind of receptor produced experiences 
or reactions supposedly specific to another sense (Howells, 
1938; Riggs & Karowski, 1934; Karowski & Odbert, 1938; 
Karowski, Odbert & Osgood, 1942). These investigations 
involved people who claimed that visual sensations arose 
from auditory stimulation and almost always reported that 
brightness of these "secondary" visual sensations increased 
with an increase in pitch of the inducing sound (Marks, 1974). 
Despite the nonexistence of consistent cross-modality 
correlations as witnessed by Wicker (1968), sufficient 
experimental evidence strongly suggests that such correla- 
tions do exist. A Significant amount of work was done by 
Stevens (1975) in developing scaling methods for relating 
these different perceptual dimensions. These scaling 


methods are discussed later. 
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BREITES RSSOCTTATTONEOE COLOR AND PITCH 

Simpson, Quinn, and Ausubel (1956) conducted an experi- 
ment with 995 elementary school children to determine the 
degree of association between six colors (yellow, orange, 
red, violet, blue, green) and six pure tone frequencies 
(125, 500, 1000, 4000, 3000, 12000 Hz). Systematic rela- 
tionships between the colors and sounds were found as 
follows: 

(1) Yellow and green were associated with the "high" 
pitched tones (8000, 12000 Hz); 

(2) Red and orange were associated with the "middle" 
pitched tones (1000, 4000 Hz); 

(3) Blue and violet were associated with the "low" 
peeechea tones (125, 250 Hz); 

(4) The color-tone relationships were not significantly 
Or consistently related to sex or intensity variation; 

E NEUE Nrhe exception of specific color-pair rela- 
tionships to tone frequency, no one-to-one spectral-tone 
frequency symmetry existed. 

An additional, more subtle, interpretation of experimental 
results was made with regard to the influence of cultural 
s s T O TS The Children (grades three, four, five and 
Six) were selected in order to minimize the influence of 
eueuralseosndad,reionines on pitch-hue relationships. The 
authors pointed out that high and low-pitched notes in 
music were conventionally used in combination with other 


elements to produce or represent contrasting moods and 
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that college students and adults, in a musical context, 
tended to associate light and dark hues with high- and 
low-pitched musical notes. It was their contention that 
cultural conditioning influenced the pattern of association 
among older subjects. Yet, because of the minimization of 
cultural influences among children, the formation of a 
Similar association pattern would-be the result: of genetic 
predisposition. The authors stated: 
The findings of definite pitch-hue associations 

in children, apart from the musical context, is 

interpreted as lending support to the view that 

Genetically determined predispositions exist for 

particular tones and hues to be perceived as 

selectively compatible with particular mood states, 

particular colors and tones become indirectly 

related to each other. (oa 103) 

The genetic implications of these results are supported 
Pe seudy done by S. S. Stevens (1975) in which adults 
and five-year-old children matched brightness to loudness. 
In this study Stevens concluded that age and prior learning 
@eawnot artect the matching process. Also, a study by 
Walsh (1978) investigated how personality indices were 
compared to color preferences, which suggests that additional 


r sssi ence color-tone matching than cultural condi- 


tioning alone. 
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IIT. EXPERIMENTAL METHODOLOGY IN THE 
ASSOCIATION OF LIGHT AND SOUND 

A. GENERAL 

Several experimental methods used in sensory scaling 
and cross-modality experiments were reviewed in order to 
provide a foundation for the design of this study. Of the 
literature reviewed, the following ees dif techniques 
and test apparatus were selected to provide a survey of 
previous testing methods involving the association of light 
and sound. Also, a brief synopsis of experimental results 
is included. 
P E ASSOCIATTON OF LIGHT AND SOUND USING 

PREON ESS?7 PITCH AND SOUND 

Marks (1974) investigated the psychological corre- 
Spondences between light and sound using the dimensions of 
brightness, pitch and loudness. Several experiments were 
conducted in which combinations of these dimensions were 
matched in the following categories: pitch and brightness 
with loudness constant, loudness and brightness with pitch 
constant, pitch and loudness with brightness constant, and 
loudness to brightness at four different pitches 
2007500, 10007, 2000 Hz). The visual stimuli were gray 
squares of different Munsell values viewed against a black 
background and then against a white background and illumi- 
nated by an incandescent lamp. The auditory stimuli were 


either pure tones or variable loudness levels generated 
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by an oscillator, amplified and fed through a "sone" 
peeenttometer =O earphones. The Experimenter (E) controlled 
the position-switch for varying the pitch and loudness. In 
these experiments the Subject (S) was to indicate to the E 
when a match had been obtained with the auditory stimuli 

as the observer viewed the visual stimuli. The Ss were 

Nai told to match increasing pitch or loudness to increasing 
brightness and could proceed in whatever way seemed natural 
to the observer. Several graphical plots of the matching 
interactions were obtained and used to outline the experi- 
mental results. The Ss repeatedly set increasing pitch to 
increasing brightness. Some observers set increasing loud- 
ness to increasing brightness while others set increasing 
loudness to increasing darkness. When brightness was held 
constant, increasing pitch was matched to decreasing 


loudness. 


O CROSS- MODALITY MATCHING OF BRIGHTNESS AND LOUDNESS 

J. C. Stevens and Marks (1966) used the method of cross- 
modality matching to demonstrate that subjective magnitude 
grows as a power function of stimulus intensity. 

Two experiments (with two sessions each) were conducted 
s CSS had. to adjust sound to match light or adjust 
light to match sound. In the first session, eight luminance 


207) were used as visual 


levels between 50 and 100 dB (re 10. 
stimuli and the observer rotated a "Sone" potentiometer 


permitting a 100 dB variation in the level of noise in 
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matching the sound to the light. In the second session, 
the observers adjusted the light to match the eight levels 
of sound between 45 and 95 dB (re 0.0002 dyne/cm^y. This 
Scaling experiment demonstrated that the cross~modality 
matching of brightness and loudness had the form of the 
"psychophysical power law of sensory magnitude," i.e., 
that subjective magnitude of brightness grows as a power 
function of loudness intensity and ee versa. This tech- 
nique was developed by S. S. Stevens (1975) in order to 
provide an experimental method for cross-modality matches 


of different sensory continua. 


Pe Lee oS OCTATION OF COLORS WITH PURE TONE FREQUENCIES 
Simpson, Quinn and Ausubel (1956) conducted an experiment 
with 995 elementary schools children in groups of 20 in 
Studying the association of spectral colors with pure tone 
frequencies. The procedure followed in this experiment was 
to present the Ss with a series of six pure tones (125, 
250, 1000, 4000, 8000, 12000 Hz). The subjects responded 
ai cacing which Of the six colors (yellow, orange, red, 
violet, blue, green) they thought of immediately after 
hearing each tone. The auditory stimuli were generated by 
an audiometer and passed through earphones to each S. 
The visual stimuli were six colors on one inch cards with 
a letter below each card corresponding to the color. The 
cards were mounted on a rectangular strip of light-tan, 


manila paper. The Ss responded by writing down the color 
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letter they felt went with the auditory stimulus. The 
result indicated that yellow and green were associated 

with high level pitches (8000, 12000 Hz), that red and 
orange were associated with the middle range pitches (1000, 
4000 Hz), and blue and violet were associated with low-pitch 
tones (125, 250 Hz). These authors referenced a study in 


which similar results using adult subjects were obtained. 


E. SCALING OF SATURATION AND HUE 

Indow and S. S. Stevens (1966) conducted a series of 
scaling experiments on the saturation of aperture colors 
using the hues red, yellow, green, blue, orange and 
yellowish-green. Similar experiments were conducted on 
changes in saturation using various colors. The colors were 
mixed by means of a rotating prism and presented through 
five apertures. In each aperture the mixing ratio of two 
colors were varied continuously and independently without 
affecting luminance. The principle of the apparatus is 
illustrated in the paper by Indow and Stevens. The study 
investigated the relation of saturation to colorimetric 
purity and luminance of aperture colors viewed in a dark 
Surround. The saturation of the hues was found to increase 
as a power function of colorimetric purity. Direct hetero- 
Eumcusricomestehsng of saturation to saturation led to the 
construction of families of saturation scales. The authors 
Stated that the scales generated in this experiment were 


not necessarily useful for practical purposes but served 
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the purpose of quantifying perceptive continua of hue and 

Saturation. Also, during the heterochromatic matchings 

of saturation, using the colors, red, blue, green and 

vellow, the authors reported that the observers were 

unanimous in pointing out that yellow looked brighter than 
blue, and that in the saturation matches a difference in 
brightness levels was not particularly disturbing. This 
article provided a very comprehensive discussion of scaling 
techniques and color matching methods. 

PF. HUMAN INFORMATION TRANSMISSION AS A FUNCTION 
BONSEDSEDEDOVISUADLCTANDOAUDIETORY STIMULUS DIMENSIONS 
Buckner and Harabedian (1961) conducted an exploratory 

study to investigate information transmission as a function 

of combinations of selected visual and auditory stimuli. 

The visual stimuli were three primary hues; red, yellow and 

green. The auditory stimuli were three pure tones 400, 

1000, and 1950 Hz. The visual dimensions were hue and 

brightness and the auditory dimensions were pitch and 

loudness. The test apparatus consisted of a response panel 
containing nine toggle switches and feedback lights in 
three rows and three columns. A speaker and stimulus aper- 
ture were located above the switches. The auditory stimuli 
were presented through an eight inch speaker and visual 

stimuli were presented through 1/2 inch aperture. A 

combination of an auditory and visual stimulus could be 

pusducedeNbut multrzple simultaneous stimuli could not. The 


equipment was designed so that stimuli could be produced at 
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three absolutely discriminable levels for each dimension. 
There were three levels of hue, nes, pitch and loud- 
ness. Each value of the quantitative stimulus dimensions 
(loudness and brightness) corresponded to one of three rows 
and each value of the qualitative stimulus dimensions 
(pitch and hue) corresponded to one of the three columns. 
[ee groups of fewr Ss received a different combination of 
stimulus dimensions. Thus, for each group, there were nine 
quantitative-qualitative stimulus combinations. Each S's 
task was to respond as accurately and as rapidly as he could 
by moving the toggle switch that represented an appropriate 
match with the stimulus. The accuracy scores were trans- 
formed into information transmission values (bits/stimulus). 
The authors presented a brief summary of studies per- 
formed on human channel capacity using different types of 
auditory and visual stimuli. The following studies and 
results were mentioned: Pollack (1952) found that the 
channel capacity for absolute judgments of pitch to be 
E NETTES; Garner (1953) using from four to twenty different 
loudness levels found a channel capacity for absolute loud- 
ness judgments to be 2.3 bits; Pollack (1953) found a channel 
eac ity of 3.17 bits for pitch and loudness together, and 
Pe Sen (1954) obtained 3.1 bits for hue and 2.1 bits for 
brightness.  Buckner and Harabedian (1961) differed from 
these studies in that the amount of input and output infor- 


Meeton was held constant in order that variations in the 
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amount of information transmitted could be observed. The 
results were stated as follows: 
Hue produced higher transmission scores and 

faster reaction times than pitch regardless of 

whether either was combined with loudness or 

brightness. Both brightness and loudness yielded 

higher transmission scores and faster reaction 

times when they were combined with hue than when 

they were combined with pitch. (p. 22) 
In addition, transmission performance of stimulus redundancy 
was complicated by the difficulty of discriminating among 
combined stimulus dimensions. The authors noted that the 
equality of discrimination which existed when subjects were 
exposed to single dimensions ceased to exist when exposed 
to two or more dimensions simultaneously. The results 
obtained by Buckner and Harabedian (1961) regarding the 
decrease of transmitted information when stimulus dimensions 
were increased may have been attributable to the set of 
experimental conditions used in their study.  Egeth and 
Pachella (1969) and Pollack (1953) stated that in absolute 
judgment tasks, total information transmitted about a set 
of stimuli increased as the dimensionality of the stimuli 
increased but as the number of dimensions increased, infor- 
mation about each component decreased.  Egeth and Pachella 
Meine rted four factors, acting singly or in combination, 
that influence multistimulus identification and may have 
contributed to this decrement: stimulus duration, distrac- 


tion, interstimulus interference, and stimulus complexity. 


The influence of these factors may affect the amount of 
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information transmitted in a multidimensional stimulus 
tent itication. Alluisi (1957), Buckner Edd Harabedian 
89517), MeCormick (1976), and Miller (1956) contain detailed 
Io mation on discrimination of various sense modalities. 
G. THE INFLUENCE OF PRACTICE AND PITCH-DISTANCE 

BETWEEN TONES ON THE ABSOLUTE IDENTIFICATION 

or PITCH 

Hartman (1954) investigated several factors influencing 
absolute judgment using pitch. The following relationships 
about the role of pitch in absolute judgment tasks were 
investigated: the effect of pitch separations on accuracy 
of judgments; the amount of information transmitted as a 
Function of pitch-distance between tones; the relationship 
of pitch separation and practice on absolute judgment tasks. 
Four series of nine pure tones, separated by 50, 100, 200, 
and 300 mels, were recorded at constant intensity and 
placed discretely on a record to permit individual presenta- 
tion. Each tone was two seconds in duration and was pre- 
ceded by a six second burst of white noise, i.e.,the following 
sequence was presented every 30 seconds: a burst of white 
noise was given to wash out the preservative effects of 
preceding stimuli (six seconds), an interval of silence 
(one second), and a pure tone for two seconds. The tones 
were presented in a predetermined order and in such a way 
that each tone followed every other tone an equal number of 
times. The sounds were presented to each S over earphones. 


The E presented one of the tones and the S had to decide 
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which tone was being presented. The S recorded his response 
Supa chart containing nine circles numbered one to nine 
(low to high) in order to assist him in picturing the 
position of the tones. Three four member groups were used 
and two experimental sessions per week for eight weeks were 
conducted. Two months after completion of the experiment, 
each S was given an additional experiment to determine how 
much information was lost ing Ehe previous experiment. 
Hartman (1954) presented a detailed discussion of the 
experimental results. The significant conclusions were 
as follows: (1) the smaller the pitch distance between 
tones, the smaller was the average error of judgment; 
(2) the wider the pitch distance beteween tones the more 
the average error was reduced by practice; (3) the learning 
curves for the 200 and 300 mel groups dropped sharply to 
asymptotes in about four weeks, while those for the 50 and 
100 mel groups were gradual, indicating the learning was 
Ber) occurring at the end of training; (4) the amount of 
transmitted information varied directly with the size of 
the pitch separation of the tones, i.e. varying the separa- 
tion by a factor of six (300/50 mels) increased the effi- 
ciency of information transfer from 40 to 70% at the end 
SEA TINO. 

The significant outcome of this experiment was that with 
wider pitch separation learning was rapid and complete 
within a few weeks which was not the case with relatively 


small pitch separations. 
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iY se PSYCHOLOGICAL SCALES OF LOUDNESS, 
FTTCI D ND SRUGHTNESS 

During the experimental design, several distinctions 
regarding the relationships of loudness, pitch, and visual 
brightness had to be made. These relationships had to be 
fully understood in order to comprehend the psychological 
processes occurring in the cross-modality matching and to 
better interpret the experimental data. In addition, the 
knowledge of these relationships influenced the selection 
of the colors, range of frequencies, and loudness levels 
used in the study. 

The terms loudness, pitch and visual brightness are 
terms that represent the psychological percepts of intensity, 
frequency and luminance. Human observers do not judge 
loudness, pitch, and luminance on a purely physical basis; 
i.e., they are not judged solely on the physical magnitude 
of a stimulus. S. S. Stevens (1975) has done a considerable 
amount of work in developing quantitative methods that 
relate stimulus magnitude to subjective sensation. Stimulus 
magnitude and several perceptual continua can be related by 
a linear function when plotted on logarithmic coordinates. 
For example, loudness magnitude is a linear function of 
sound pressure level (dB) when plotted in log--log coordi- 
nates, i.e.,perceived loudness approximates a power function 
ee anulus intensity (Richards, 1976). This power function 


for loudness is one instance of what S. S. Stevens (1975) 


— 





has called the general "psychophysical law." Visual bright- 
ness scales, magnitude scales of Brass and scales for 
matching brightness and loudness have been developed based 
on this general "psychophysical law." These power functions 
are useful because numbers may be matched to sensations 
(magnitude estimation); loudness scales may be represented 
as a power function of stimulus intensity. However, psycho- 
physical scales of pitch (Mel scales, relating subjective 
pitch to frequency), do not behave according to this "psycho- 
physical law." The Mel scale is represented by a curvi- 
linear form. Graphs of pitch (in Mels) versus frequency 
MR) appear in S. S. Stevens (1966b, p. 1003) and 
Richards (1976, p. 110). Stevens provides the following 
graphical interpretation of the Mel scale: subjective pitch 
increases less and less rapidly as stimulus frequency is 
increased linearly; subjective pitch increases more and 
more rapidly as stimulus frequency is increased 
scc thmically. 

The existence of linear and curvilinear magnitude scales 
show a fundamental difference in perceptual continua. 
S. S. Stevens (1975) noted that perceptual continua divide 
themselves into two categories, prothetic and metathetic 
continua. A prothetic continua represents sensations that 
have degrees of quantity and magnitude, and are power 
functions of stimulus magnitude, i.e., agree with the 
general "psychophysical law." Examples of prothetic continua 


are loudness, brightness, saturation, and hue. Metathetic 
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continua represent sensations that are qualitative, and 
emenge Because of differences in the locality of the stimulus. 
Examples of metathetic continua are pitch and apparent 
Pemsmtlon, 1.€., pitch varies from high to low and in a sense 
has a kind of position. Visual saturation and hue were once 
thought to be metathetic but Indow and S. S. Stevens (1966) 
Suggest they behave as prothetic continua. Stevens (1975) 
attempts to clarify these distinctions between prothetic 
and metathetic continua by the following statement: 
No formula can capture all the richness of the 
daily sights and sounds and tastes and smells which 
our sense organs admit to us. Nevertheless, once 
we make a few baSic distinctions, there emerge some 
principles that relate specific aspects of sensation 
to certain properties of stimulus forces. A chief 
distinction is the one between quantity and quality, 
Or magnitude and kind, or size and sort. No pair of 
common words quite fits the distinction; but what it 
Means Comeretely 15 that sweet is different from sour, 
although both may vary from strong to weak. (p. 12) 
The importance of the work of Stevens (1975) in magnitude 
estimation and cross-modality matching is that it provided 
a means by which any perceptual continuum could be matched 


to any other continuum (Indow and Stevens, 1966; Richards, 


1976; S. S. Stevens and Marks, 1965; S. S. Stevens, 1975). 
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V. PARAMETER SELECTION 


A. GENERAL 

The parameters for this experiment were selected on the 
basis of human factors deSign criteria and the visual and 
auditory coding dimensions used in previous experiments. 

Pecerndang to McCormick (1976) there are three types of 
human functions involved in the reception of visual and/or 
auditory signals. These functions are relative discrimina- 
tion, absolute identification, i.e., a particular signal 
of some class, when only one is presented; and, specific 
task requirements of an operator, a general term, which 
includes various tasks required of an operator, i.e., signal 
detection, target location and identification, visual scanning, 
control selection and adjustment and "decision making." 
Sheridan and Ferrell (1974) state that many judgments people 
make of size, duration, or velocity are absolute judgments 
and instead of comparing two observations, people judge 
observations against a remembered standard. Absolute 
judgments are expected to be precise, but people commonly 
make comparative judgments when precision is required. 
Thus, the difference between absolute and relative discrimi- 
nation is often times very small. 

There are three sets of variables that impose demands 
for information presentation and data display. These demands 


were developed by Henneman and Long (1954) when considering 
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u Detween the eyes and ears as sense channels for 
presentation of information. These sets of demands were: 

(1) demands impcsed by operator variables (e.g., fatigue, 
motivation, personal habits, expectancy); (2) demands imposed 
by response variables (e.g., fine quantitative comparison, 
deute discrimination, target location and identification, 
signal detection); (3) demands imposed by special environ- 
mental conditions (e.g., ambient noise, change in illumina- 
tion, masking). A later study cited that the degree 

of familiarity, meaning and difficulty of material influenced 
the comprehension of information (Day & Beach, 1959). 

The selection of information dimensions is largely a 
function of these variables that cover a broad range of 
demands on the operator and his or her workspace environment. 
These considerations, though somewhat general, provide a 
basis for selecting color and sound as coding dimensions. 

Several references are devoted to the comparison of the 
auditory and visual senses as information channels (Cheatam, 
1959; Henneman & Long, 1954; McCormick, 1976; Mowbray € 


Euro P058; Mudd, 1961). 


B. COLOR AS A CODING VARIABLE 

Advances in hardware technology have made color a highly 
feasible coding dimension. The use of multicolored CRT 
displays, operational display panels, and additional decision 
making aids has placed new burdens on the operator. Christ 


Mo as out that the ultimate criterion for deciding 
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whether or not to introduce a change in the design of the 
display is not how "nice" it looks or how technologically 
sound it is but how much it will enhance total system 
performance subject to the limiting objective performance 
of the operator. The esthetic value of the use of color 
is well established but a review of literature by Christ 
(1975) showed that even when operators preferred color 
displays and were convinced color aided performance, 
subjective operator reports were not consistent with the 
objective data regarding color effectiveness. 

Experiments have been conducted with one and two 
dimensional displays and with relatively simple single tasks 
(choice reaction, search and locate, multiple-target 
identification). The conclusions stated that color was 
most likely to benefit performance in any task if the 
Operator was to deal with complex, multiple stimuli and 
had to distinguish one class of stimuli from another. The 
results also stated that it appeared color assisted the 
ENSects in organizing inputs from the display (Christ, 
NUS Jones, 1962). 

Color is not suited for situations demanding rapid and 
precise identification but it is suited for search and 
location, recognition and verification tasks. As a coding 
dimension, hue-brightness dimensions are better suited 
than size-brightness for accuracy and speed.  Ericksen (1952) 
Bepereced that Scanning a group of visual objects in order 


to locate or count are better performed with color codes 
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than a variety of other codes. Furthermore, color seems to 
be an important determinant of location A ed with dense 
visual displays. If colored lights are to be used for 
coding and if color-blind people will have to use the color 
code, only certain colors (red, green, and blue) are recom- 
mended for use. The Air Force Systems Command Design Hand- 
book for Personnel Subsystems, DH 1-3 (1972) states that 
these colors should meet standard military requirements 
(MIL-C-25050) because there are many red, green and blue 
mues that color-blind people cannot correctly identify. 
These colors should be used at moderate distances because 

at great distances blue is often confused with green. The USAF 
Systems Command Design Handbook, DH 1-3 (1972), Handbook 

of Human Engineering Data (1952), McCormick (1976) and 
Woodson and Conover (1964) contain additional information 
on the visual capabilities and limitations to make decisions 
concerning man's capacity to perform system functions. 

In terms of information transmission measures, the 
capacity for absolute judgments of visual stimuli in a 
single dimension varies between 2.1 and 3.1 bits. Typically 
man can discriminate on an absolute basis about five bright- 
nesses of lights and ten colors. Yet for normal operational 
use only three to five colors are employed. The Human 
Engineering Guide to Design Criteria for Military Systems 
Equipment and Facilities (MIL-STD-1478B) suggests the 


Ao ano Color Coding scheme for information displays: 
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Color State Result 


Flashing Red . Emergency Immediate operator action 
Red Alert Corrective/override action 
must be taken 
Yellow Advise Caution recheck as necessary 
Blue Advisory Should be avoided 
Green Proceed Condition Satisfactory 


In this present study five Kodak Gelatin Wratten 
Filters were used as the colored stimuli. The color speci- 
fications are listed below. The blue color was the standard 
color because it allowed for the minimum passage of the 


brightness when all colors were set at maximum photometric 


brightness. 
Color Wratten No. Wavelength (in nm.) 
Blue (B) 45A 477 
Green (G) 61 536 
Yellow (Y) 15 579 
Orange (O) 22 595 
Red (R) 29 Gon 


Barker and Krebs (1977) provide an annotated biblio- 
graphy of abstracts and references for 78 studies which 
are concerned with one or more aspects of color effects on 
human performance with emphasis on color as a coding dimen- 


Een various tasks. A brief comparison of color and 
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sound and the conditions in which each is more effective 


is provided in Appendix B. 


C. PITCH AS A CODING VARIABLE 

Several auditory coding methods exist but frequency and 
intensity are the more commonly used dimensions. It appears 
that the capacity for absolute judgments of auditory stimuli 
iia Single dimension (e.g., pitch) is approximately 2.3 
bits, or about four to seven categories of pitch may be 
employed in absolute-judgment tasks (McCormick, 1976). 

In a noisy operating environment signal intensity has to 
be set at a level far above the ambient noise level in order 
to be detected. If several "meanings" are attached to a 
Set of intensity levels (four to eight) of a pure tone, then 
the range of single intensities is rather restrictive, 
approximately 60 to 100 dB; the range of intensity levels 
is a function of signal detectability among ambient noise 
and comfortable operator thresholds. On the other hand, 
four to sevel low frequencies at an approximate equal 
intensity setting above an ambient noise level are better 
suited for relative and absolute discrimination tasks. 
McCormick (1976) provides some guidelines for the selection 
or design of warning and alarm signals. These design 
recommendations are as follows: 

l. Signals to be discriminated on the basis of frequency 
should be between 500 and 1000 Hz, though the ear is most 


sensitive to the range of frequencies 200 - 3000 Hz. 
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2. When signals have to travel long distances (1000 
feet) frequencies below 1000 Hz should be used, 

3. When signals have to "bend around" major obstacles 
or pass through partitions, frequencies below 500 Hz should 
be used. 

4. If different warning signals are used to represent 
different conditions, each should be discriminable from 
the other. 

5. In order to minimize masking, signals with frequen- 
cles different from those that dominate background noise 
Should be used. 

6. High intensity, sudden on-set signals should be 
used to alert an operator. 

In addition to these considerations, the frequencies 
used in this study were selected based on experimental 
results related to information transmisSion. Hartman (1954) 
Studied the influence of long training on pitch judgment 
as a function of the range of stimulus frequency. Sheridan 
and Ferrell (1974) explained Hartman's results as follows: 

There was at first little difference among 

groups in information transmitted. After seven 

weeks of practice all the groups of subjects had 

improved, but those with greater stimulus range 

and a wider pitch separation (in mels) between 

tones, showed greater improvement. The absolute 

difference between tones may govern their ultimate 

ser nrnapiliry, SO Ehat practice tends to 


increase the normally slight dependence of trans- 
mission on stimulus range and spacing. (p. 102) 
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Hue trequeney specifications used in this study are 
listed below. The reference tone was 1500 HZ at a loudness 
level of approximately 80 phons (80 dB SPL re 0.00002 
me neem). The average pitch separation for this study 
was approximately 200 mels. The pitch values were extrapo- 
lated from the psychophysical Mel scale for pitch perception 


referenced in Richards (1976). 


Frequency (Hz) Pitch (Mels) Separation (Mels) 
373 DO °e e e e e o o 0 o @ °° 150 
>00 650 ə ° @ o o o o e o ° ° ° 250 
750 850 Ë o e@ o e e o e e o ° ° 150 
1000 1000 e... ....—..e .. 300 
1500 1500 


Additional auditory selection criteria are discussed in 


Appendix B. 


BESZMATCHING CRITERIA 

In order to investigate the association of color and 
Perehrzceherättributes 0f brightness and saturation in color 
and loudness in sound had to be isolated and adjusted in 
order that the colors appeared subjectively equal in bright- 
ness and the sounds appeared subjectively equal in loudness 
to each S. Therefore, five different colors had to be 
simultaneously adjusted (controlled) for brightness and 


saturation in order to isolate the hue aspect. It was 
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assumed that saturation was correlated with bright- 

ness within a broad control region of ness (Indow & 
S. S. Stevens, 1966). Also, the five different sounds had 
to be simultaneously adjusted for loudness in order to 
isolate the pitch aspect. 

The matching criteria of loudness and brightness was 
based on a property common to all human senses, i.e., a 
Person can distinguish a condition of equality with very 
good precision, the eye being particularly good at this. 
The estimation of the relative brightness of two lights of 
the same quality seen adjacent to each other is exceedingly 
precise. Also louder and softer are easy comparative 
decisions (Mowbray & Gebhard, 1958). Thus, the S made 
matching judgments that required him to isolate in his mind 
one aspect or particular quality, in the appearance of the 
test stimuli, when other aspects were present in different 
degrees.  Wyszecki and Stiles (1967) provide matching 
criteria for brightness by the direct comparison method 
ER -cunecheMcest stimuli may differ in saturation, hue, or 
both. The assumptions made in using this technique are 
that the light patches are homogeneous in appearance over 
the whole viewing area, at least with respect to the quality 
being judged, the test stimuli must be geometrically similar, 
and matched on the same retinal area. A parallel matching 
criteria was established for the loudness matching. 

However, for this present study, the criteria provided 


by Wyszecki and Stiles (1967) was slightly modified. Five 
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lights (tones) were matched for brightness (loudness) vice 
two. A preliminary (exploratory) brightness matching 
experiment using different colors in pairs was conducted 
before the present experiment was designed. Two colored 
lights were matched for brightness using the comparison by 
slow alternating method described by Wyszecki and Stiles 
(1967). The experiment was to determine if group brightness 
levels could be established. However, the degree of varia- 
bility using this direct comparison technique was so large 
it was decided to allow each S in this present experiment 
to adjust and establish his own subjective brightness 
settings. Also, although different frequencies may be equal 
in acoustic (physical) intensity, an observer may perceive 
the loudness level of each frequency to be different. There- 
fore each S "adjusted" each frequency until each tone was 
equal in subjective loudness. 
ae INFORMATION TRANSMISSION USING THE COMBINED 

DIMENSTONS OF COLOR AND PITCH 

A sizeable amount of experimental work has been done 
Supporting the concept of man as a limited information 
channel. Garner and Hake (1951) applied information measures 
EN onus bad Ev to discriminate stimuli, and Miller (1956) 
stated that the number of categories into which stimuli 
could be assigned is near seven. The number of stimulus 
categories (per sense modality) to be used in absolute judg- 
ment tasks is specified in several human engineering design 


handbooks. For instance, it is recommended that no more 
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than eight categories be used for hue and five for sounds 
in absolute judgment tasks. McCormick (1976) recommends 
specific frequency Es: to be used in warning signal 
design, about 500 - 1000 Hz. These specifications are 
recommended guidelines, however. But stimulus categories 
and discriminability are not the only factors affecting 
man's information transmission abilities. 

The use of multidimensional coding redundancy and 
extended practice contribute to the efficiency of man as a 
limited information channel, as well. But, just as these 
factors influence information transmission efficiency, 
other factors, namely, observation time, stimuli range and 
spacing of stimuli along a dimension, apparently do not 
significantly affect efficiency. Sheridan and Ferrell (1974) 
K C tnat much of the significance of the limited capacity 
of absolute judgments to transmit information about a single 
Stimulus dimension stems from man's insensitivity to these 
important factors. Observation time of a stimulus, unless 
ENS verv short, has only a slight effect on information 
transmitted. Sheridan and Ferrell (1974) state that absolute 
BepaGatlon along a continuum is not a criterion for discri- 
minability among stimuli judged on an absolute basis. By 
increasing the separation between stimuli and hence the range 
for a given number of stimuli, the confusion between stimuli 
is reduced. By increasing the range, the amount of informa- 
tion transmitted is increased, but only up to a point. The 


Spacing of stimuli within a range nas a relatively slight 
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effect on judgments provided the spacing is generous 
Petekwson & Hake, 1955; Pollack, 1952; Sheridan & Ferrell, 
mee). For example, Pollack (1952), as noted by Sheridan 
cere rrei|] (1974), compared judgments of pitch of eight 
tones logarithmically spaced between 100 and 8000 Hz with 
judgments of four tones in the range of 100 to 250 Hz and 
four tones in the range 2000 - 8000 Hz and found essentially 
no difference for the two cases. Beer and Harabedian 
(1961) investigated information as a function of selected 
visual and audıtory stimulus dimensions (hue and brightness 
and pitch and loudness, respectively) as described in 
Section IV, Paragraph F, above. The equivalent Settings 

in mels of 500, 1000, 1500 were selected because of the 
equal discriminability of the frequencies that corresponded 
to the pitches. These authors contended that the equal 
discriminability of pitches 500 mels apart could be easily 
discriminated as the hues. They reported no significance 
in discriminability among the hues and pitches in terms of 
number of errors or reaction times. Furthermore, the number 
of dimensions and number of bits per dimension contribute 
to the information of a stimulus set, and operators can 
distinguish among different dimensions better than they 

can among variations along a single dimension. Multiple 
dimensions can be used to create redundant coding in which 
the same information may be presented more reliably. The 
selection of the frequency range (375 - 1500 HZ) and octave 


spacing within frequencies was based upon the signal design 
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ps:ergsa as referenced in McCormick (1976), though previous 
experimental work involved frequencies between 250 and 

12000 Hz Econ inn & Ausubel, 1956) and 400 to 1950 Hz 
(Buckner & Harabedian, 1961). The information measurement 
procedures used to calculate experimental information 


transmission data are explained in Appendix C. 


EE 6 BOUAL LOUDNESS CONTOURS 

In order to maintain a reliable degree of auditory 
Standardization throughout the study, the reference tone 
(1500 Hz) was held constant at 80 dB Spl (80 phons); the 
loudness levels of the four frequencies (375, 500, 700, 
1000 Hz) were subjectively matched by each S to the standard 
loudness level of the reference tone. The loudness level 
(in phons) over the frequency range (375 - 1500 Az) is 
Meecoximately linear. The significance of this is that 
the subjective loudness of each tone (over the range 
375 - 1500 Hz) is approximately equal at 80 dB Spl (McCormick, 
1976; Richards, 1976). Sound level measurements were 
recorded for each S in order to determine the degree of 


variability among Ss with regard to this standard. 


G. SUMMARY 

The selection of a coding variable to symbolically 
represent different kinds of information depends on the way 
in which an operator will use the information presented to 
him. Except for the information conveyed by warning and/or 


emergency signals, information may be qualitative or 
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quantitative in nature. A qualitative reading includes 
judgment of trends, rates of change, approximate values, 
etc. A quantitative reading includes an exact numerical 
reading of temperature, rpm, speed, etc. The scaling of 
quantitative codes is based on the lower and upper limits 
of the scale, the number of steps to be used in each scale 
and spacing of the scale to ensure uniform accuracy all 
along the scale (Garner & Hake, 1957). The factors dis- 
cussed in this section were based on the demands of the 
operator, his performance, and work environment. The 
interaction of frequency and intensity, and the quantita- 
tive relationships among these auditory dimensions influenced 
the selection of tones, frequency range and reference 


Standard. 
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Vite SOURCES OF VARIABILITY 


A. GENERAL 

In order to design test equipment and establish consistent 
experimental conditions several sources of variability had to 
be identified and accounted for. For instance, brightness 
matching for different colors is affected by stimulus color, 
Paexgroune (surround), and the amount of ambient illumination. 
Loudness matching of different frequencies is affected by the 
amount of ambient noise, and the interaction of intensity 
and frequency. These are but a few factors that must be 
eee i dered. The sources of variability that could affect 
this study were identified as follows: matching method in 
the brightness matching of light sources, stimulus intensity, 
surround, operators (Subjects), and nationality. These 
choices were not meant to be inclusive as additional factors 
are involved. Several authors have addressed the following 
additional areas as affecting variability in absolute judg- 
ment tasks: multidimensional discrimination (Lindsay, 
May lor & Forbes, 1968), effects of discriminability and 
irrelevant information on absolute judgments (Morgan & 
Alluisi, 1967) and the effects of fatigue, age, practice, 
and proximity to a meal, on visual and auditory reaction 
times (Forbes, 1945). 

A aei onal references cited in the bibliography address 


the information content and discrimination levels of lights 
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and sounds. The significant point is that the systems widely 
applied in the military and industry employing lights and 
sounds (separately or in combinations) must be appropriate 
for the majority of laymen (Halsey, 1959) and must be 
@estgned to account for large variances in the operator 


population. 


B. VARIABILITY OF VISUAL COMPARISON TECHNIQUES 

There are well established inconsistencies between 
observers' judgments of equal brightness of several light 
sources under conditions of direct comparison. These 
discrepancies are especially large when lights differ 
K Jy in color. This variability has been attributed to 
the unreliability of the direct visual comparison technique 
and from the confusion of saturation with brightness. A 
preliminary experiment to this study was conducted to inves- 
tigate this variability. The method used was to match five 
different colors for brightness using slow alternating 
presentations of two colored lights until all five colors 
had been subjectively matched for brightness. The vari- 
ability in the matching was so large that the method had to 
be discontinued. The effort, though time consuming, was 
insightful and necessitated a change in test equipment 
design to one in which five adjacently mounted lights were 
to be simultaneously adjusted for equal brightness by each 
S. Wyszecki and Stiles (1967) provide comprehensive tech- 
nical explanations regarding the difficulty of brightness 


matching using direct comparison techniques. 
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S INTENSITY 

The lowering of brightness levels brings about noticeable 
decreases in color identification and consequently greater 
reduction in discrimination. A large increase of luminance 
May cause a hue to lose its color aspect and take on the ~ 
appearance of a whitish glare. Reduction of sound intensity 
levels causes tones to become indistinguishable from ambient 


noise and other sounds used for signalling. 


D. OPERATORS 

Systems employing operators not trained for specific 
performance tasks must allow for marked individual differ- 
ences (e.g., nutrition, expectancy, previously learned 
habits, sex and anatomical differences, visual and auditory 
acuity, training, age). Also, a percentage of tne user 
population may be color and/or sound defective. Extended 
and periodic practice also affects an operator's ability to 
discriminate and remember assigned information content of 


Signalling devices. 


ee SURROUND 

we enti fication and auditory discrimination are 
affected by adapting light and ambient noise, respectively 
(i.e., background). For example, red night lights completely 
negate refined surface color coding and auditory signals may 
be masked by ambient noise or similar signals. Colored 
lights are not so affected by the adapting illumination 


(i.e., red ready room lights) as are surface colors. 
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F. NATIONALITY 

NM Uu PHEST,) cas well as genetic factors, affect the 
association of particular colors with particular pitches, 
then differences in nationality should bring out this 


possible source of variability. 
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NIL METHOD 


oe EXPERIMENTAL SETTING 

The experiment took place in a semidark, soundproof 
cubicle with gray surround. The ambient light level was 
approximately one foot candle and the ambient noise level 
was negligible. The E and S sat next to each other for 
issuance of instructions and test execution. The S was 
seated directly in front of the apparatus that included the 
light stimuli and response buttons, and between two loud- 
speakers which were directly behind the S. The sound 
generating and amplifying equipment were located outside 


the cubicle. 


B- EQUIPMENT 

Each auditory stimulus was generated by one of five 
Hewlett Packard Audio Frequency Oscillators -- Model 204C. 
The oscillators were connected in series and each was preset 
to the desired frequency (Figure 1). The loudness level of 
each tone was adjusted by rotating the amplitude control 
knob located on each oscillator. The oscillators were 
connected to one of five sound buttons on the S's response 
console (the stimulus-response console will be discussed 
later). A Single cable connection was fed into the acces- 
Sory channel of a MAICO Dual-Channel Research and Diagnostic 
Oscillator--Model MA 24B. Figures 2 and 3 illustrate the 


components of the sound generating and amplification equipment. 
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Figure 1. The Hewlett-Packard Audio-Frequency Oscillators 
(Model 204C) 
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Figure 2. MAICO Dual Channel Audiometer (Model MA-24B) 





a 


Figure 3. Set up of the MAICO Audiometer and Audio Frequency 
Oscillators Outside the Sound Booth 
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A block diagram of the functional relationship among the 
items is presented in Figure 4. Loudspeakers located 
inside the cubicle were connected to the MAICO as output 
channels. Therefore, by pressing one of the response 
console sound buttons, a sound signal (input) was fed into 
and amplified by the MAICO and was heard over the loud- 
speakers (output). The following MAICO accessory controls 
meee preset at the following positions: (1) the output 
Switch was set to "SPEAKER," (2) the test stimulus switch 
was set to "ACCESS,", the SPEAKER GAIN SWITCH was set 
at-level"8", (3) the MIXER switch was set at "BOTH," 
Buche’ -20 dB NORM control was Set at "NORM," (5) the 
Hearing Threshold Level was set at "65 dB," (6) the Test 
Presentation switch was set to "ON," (7) the Talk-over 
Gain, Talk-back Gain, and Monitor Gain were set at level 
me Tn addition, during the first session of the experi- 
ment, the MAICO was used for two way communication between 


mee Ff and S (in the cubicle). 


VISUAL STIMULUS AND AUDITORY RESPONSE CONSOLE 

The major components of the visual stimulus and auditory 
response console are illustrated in Figure 5. The console 
dimensions were 10 in. deep (at the base), 12 in. wide, and 
18 in. high with the top, sides, and base being constructed 
from 1/2 inch plywood. Five 1 1/2-in. diameter projector 
lamps were adjacently mounted on a Supportive aluminum 


I The lamps (and strip) were anchored to the top of 


5I 











quowdtnby JO ATUSUOTIBTSH TeuotTyouny 3UJ Jo weiderdg “H SANTA 


s19axeads 
jnd4no o4 OOIVW Uo:ij ieugSrs punos perjriduge Surpoo] orr^ BSutyoouuog (€) 


UOTIBOTJTTAUE XOJ ODIVH 09 S9UYDYTMS PUNOS WOIF SATA SƏurqoəuuoo (Z) 
9[osuoo uo seuo4rA4s punos o3 serouenbaujg ƏATjJ Surqyuasald SaJTM gur3oeuuo) (i) 


ətorqno 9531 


SJOq8TTIO?SQ 
Kouonboau J 


9TosuojQ 
əsuodsəy punog pug 
MUIS TENSTA- 


SIATM 
BUT YOIUUOD 


(£) 
J3atyrpquy 
ODE WN 
sı34eadg 
— 7 


— Q  . PP AAA I" 





>27 








The Visual Stimulus and Response Console 


igure 5. 
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ene console. An aluminum plate (12 in. x 15 in., 1/16-in. 
thick) was attached to the front of the console on which a 
vertical row of five sound buttons (white push buttons) and 
a horizontal row of five brightness potentiometers (black 
knobs) were mounted. Located below each brightness control 
knob was a Single pole, single throw toggle switch. 

ies veretcal row of sound buttons corresponded, in a 
hierarchical ordering, to the highness and lowness of each 
EE c-uocrom top to bottom, i.e., the first (top) button was 
connected to 1500 Hz, the second button was connected to 
1000 Hz, and so forth. This association remained fixed 
throughout the experiment. The sound buttons provided the 
means for responding to the light stimuli. 

Each projector lamp consisted of a base and 5-in. tube 
extension, 1 1/2 in. in diameter. The length of the row of 
lights was 10 in. with about l in. separation between each 
lamp (Figures 5 and 6). A hollow cylinder containing the 
colored filter and diffuse filter was enclosed within the 
5-in. outer, cylindrical sleeve of the projector lamp. The 
hollow inner cylinders could be easily removed and exchanged 
with the other lamp cylinders. One of the five gelatin, 
color filters was placed on the observer's side of the lamp 
and the diffuse filter was placed directly behind the color 
filter. Both filters were placed perpendicular to the line 
between the light bulb and the S (Figure 7). A lightweight 


box with gray interior was constructed and placed to enclose 
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the entire row of projector lamps. In addition, it provided 
the means to offset the viewing distance (29 in.) between 
the projector lamp and the S. The dimensions of the box 
Mete 16 in. long, 12 in. wide and 4 in. high (Figure 8). 
Since the viewing area of each light was recessed in a dark 
surround within the box, each filter could not be discri- 
minated in the ambient light until the selected lamp was 
Purned on. Also the amount of mene generated by one light 
ennO provide a sufficient amount of light to illuminate 


neighboring lamps. 


Pe SUBJECTS 

The Ss for the experiment were 50 male, military-officer 
students from the Naval Postgraduate School. Ss ranged in 
age from 27 to 41 years. They were divided into three 
groups according to nationality: 30 Americans (USA), 
10 Indonesians, and 10 Koreans. During preliminary loudness 
matching and brightness matching sessions, the Ss remained 
naive as to the ultimate purpose of the experiment. The 
preliminary loudness matching session additionally served 
as a hearing test to determine if Ss could discriminate the 


auditory stimuli. All Ss volunteered for the experiment. 


fee PROCEDURE 

The basic procedure was to have Ss subjectively match 
each of five tones for loudness (reference 1500 Hz, 
80 dB (SPL)), and then subjectively match all of the five 


realer dichtes for brightness (reference blue, set at 
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maximum photometric brightness). The instructions (Appendix 
D) were orally issued but were standardized for the entire 
group. The instructions for the loudness and brightness 
matching made no reference to the ultimate purpose of the 
experiment. The description of loudness and brightness 
matching procedures was discussed in paragraphs F and H, 
below. 

After the preliminary matching on were completed, 
each S was presented with a series of five colored lights, 
one at a time, and had to match a different tone to a 
different light. The lights were turned on, one at a time, 
in a random order to eliminate positional effects on the 
color-tone choices. Random positional arrangements of the 
five lights were also presented to each S. Any serial 
combination of R, Y, O was deliberately avoided, however, 
so as not to influence responses by such a close spectral 
association. The colors B and G were intentionally posi- 
tloned to reduce such influence. 

When a light was turned on by the E, the S was to respond 
by depressing a sound button which he "felt" should be 
matched with the colored light. After the response, the 
light was turned off and the response was recorded by E. 
Immediately thereafter, another light was turned on soli- 
citing a response. The S was to match as quickly as possible 
though response time was not recorded. Each light was pre- 


sented for approximately two seconds and the interval 
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between light presentations was about one second. During 
the color-tone matching the Ss were not required to order 
ene matches in any particular direction. They were told 
to perform the matches in whatever way felt natural or 
intuitive to them. Moreover, each S was also told that he 
could change his mind by changing a particular color and 
tone match but eventually a consistent matching pattern 
would be attained. | 

A trial was defined as one series of the five lights, 
each presented once. Therefore, when the S had been 
presented each light once and performed one color-tone 
match for each light, he had performed one trial. The 
experiment was stopped when the S performed consistent 
color-tone matches for two consecutive trials. After the 
two-trial criterion had been reached, the S was dismissed. 
The responses were tallied, the equal loudness and bright- 
ness levels (except for the standard color and tone) were 
reset. The colored filters were placed in a different 
random arrangement for the next S. This marked the termina- 


tion of the experimental Session. 


oe SeUDN@Ss MATCHING PROCEDURE 

During this phase each S was to match the five tones 
zer loueness using the 1500 Hz, 80 dB tone as a reference. 
Beer mer feasible to give the S direct controls for 
adjusting loudness. Prior to matching the S was told to 


press each sound button once. This was done in order to 
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assist him in identifying the difference in the loudness 
aspect when pitch changed. He was then explained the 
matching adjustment technique and he began by alternately 
pushing the top button (reference button) and then the 
second button in sequence. When the S wished the loudness 
@e the second button to equal the loudness of the reference, 
he instructed the E (located outside the sound booth) to 
increase or decrease the amplitude of the tone. After the 
second button was adjusted, the S pushed the reference 
button and then the third button in the vertical row. Once 
the adjustments were made for this pair, the fourth and 
fifth buttons were adjusted similarly. Once the S had 
equally adjusted all the tones for loudness, he was instructed 
Fozpush all Buttons, one at a time, in any order, to insure 
he had attained a good loudness match. At the same time 

he was told to try to remember what each tone sounded like. 
Thus, he became acquainted with the different tones. After 
he had completed this final equal loudness check, the E 


immediately moved on to the brightness matching session. 


G. LOUDNESS LEVEL MEASUREMENTS 

Loudness level measurements were made with a Portable 
General Radio Sound Level Meter (Type 1565-B) and were 
recorded for each S after he had made is equal-loudness 
settings and completed his experimental trials. The 
Sound. Level Meter was placed on top of the Stimulus-Response 


Console. The sound phone was pointed in a direction 
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perpendicular to the noise path. The E's body was behind 
the sound phone out of the noise path. The Symbol "(x)" 

in Figure 4 marks the position at which the measurements 
were taken. The sound phone was facing in the direction of 
the frequency oscillator. Each sound button was pressed 

one at a time and the loudness level of the sound was 
measured and recorded. The C weighting scale was used based 
Soe che technical manual; i.e., the c scale was closely 
correlated with subjective estimates of loudness. After 

all loudness levels were recorded, the E reset the loudness 
level of each tone (except the reference tone) in preparation 


for the next S. 


H. BRIGHTNESS MATCHING PROCEDURE 


During this phase the S was to match five adjacently 
placed colored lights for brightness. All lights were 
Simultaneously turned on. The S was instructed to make each 
light appear equal in brightness to the blue light by 


adjusting the potentiometers positioned below each light. 


Pe oRUGHINESSs LEVEL MEASUREMENTS 

Brightness level measurements were made with a Weston 
Illumination Meter (No. 756-no filters) and were recorded 
for each S. The measurement procedure was conducted in the 
following manner. After the S exited the cubicle the 
brightness of each light was individually measured. Only 
one light was on at a time. The hand-held illumination 


meter waS placed directly in front of each light in such a 
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manner that only the light source was measured, uninfluenced 
by ambient light within the cubicle. The angle of incidence 
during measurement remained the same for each light from S 
to S. The observations were recorded after each measurement. 
After all lights were measured the colored filters were 
rearranged for the next S. The brightness levels (except 


for the blue color) were also reset. 
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Ug RESULTS 


A. COLOR-TONE PREFERENCES 

Doce reguencses of Color-tone matchings on the criterion 
psal for all 50 subjects are presented in Table ja The 
relative frequencies of choice (shown in parentheses) 
were calculated based on the E ECE Of o0 eoe 
tone matchings (event-pairs). Five subjects (all U. S. 
EmErcers) attained consistent color-tone matchings in two 
trials, suggesting a cognitive difference in matching 
strategy may have existed for these subjects. Accordingly, 
results for all 50 subjects were separated into the frequency 
of color-tone matchings for the 45 subjects who required 
more than two trials and the five U. S. subjects who completed 
the task in two trials. The data appears in Tables 2 and 3, 
respectively. Inspection of these results indicate that the 
color-tone frequencies of the five subjects do not reflect 
a consistent pattern that is different from the group 
results. Therefore, the results for these five are grouped 
Eu cHe results of the other 25 U. S. Officers for subse- 
quent analyses. Table 4 contains the matchings on the 
Seteerion trial by nationality. The results in Table 4 
suggest that a color-tone selection preference exists for 


certain colors and tones by nationality. 


Results by trial showing choice, number of subjects and 
the amount of information transmitted per trial are displayed 
in a separate Data Appendix, Appendix E. 
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Table 1 


Brequency Of Color-Tone Matchings on the Criterion Trial for All Subjects 
(Relative frequencies are shown in parentheses) 


(lors Tones Row Sums 
S 200 750 1000 1500 
Red T y TO 3 26 50 
(.028) , 016) (on (.012) @ (220) 
Yellow 4 6 JL 14 15 50 
(.016) . 02h) uuo OO (.06) (.20) 
Orange 6 i 12 21 4 50 
(.024) .028) Preys) 20.082) (LOTO) (eo 
Green 8 22 IBS 6 l 50 
(.032) . 088) ob) (.02h) (06h) BS 
Blue 25 I] y 6 l 50 
(.10) Ohh) (els) (29915) (3016) COn 
(Column 
Sums ) 50 50 50 50 50 250 
(20) (720) Fao) (.20) (729) (1) 
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Table 2 


Mrequency of Color-Tone Matchings on the Criterion Trial for All Subjects 
Less Those Who Attained A Color-Tone Match in Two Trials 
(Relative frequencies are shown in parentheses) 


K lors Tones Row Sums 
S 200 PO 1000 1500 


Red 6 3 9 B 24 45 
(.026) (.013) (.04) (COLS) loa (20) 


Yellow 3 5 LO 13 14 45 
(.013) 2922) (TONG) (7058) (.062) (.20) 
Orange 6 7 Ji: 19 2 ho 
ees) (031) (.049) (084 ) (.008) Eo 
Green 8 20 je: 5 1 ys 
(.036) (.C89) (.049) ( 022) cool eT 
Blue 22 10 h 5 h 45 
(.098) (OHH) (.018) (.022) (.018) (.20) 
(Column 
Sums) 45 45 L5 45 45 225 


( .20) (.20) 220) C220) (20) 1) 
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Table 3 


M@eeguency Of Color-Tone Matchings on the Criterion Trial for Subjects 
Who Attained a Color-Tone Match in Two Trials 
(Relative frequencies are shown in parentheses) 


Eolors Tones Row Sums 
515, 500 750 1000 1500 
Red 1 1 l O 2 5 
m D ol (19 ( .00) (.08) (.20) 
Mellow ER Ju Hb T E 
NONIS (.04) (TOL) uH (ob) (.20) 
Orange O O T 2 2 5 
oo oo) (FOL) (.08) (.08) (.20) 
Green O 2 2 AL O D 
(200) (08) (.08) (.04) (200) ( 
Blue S ja O d O 5 
(.12) ( . Oh) ( .00) (.04) ( .00) ( 
(Column 
Sums) y 5 5 5 5 25 
220) ( .20) (.20) (.20) (.20) ( 
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Table 4 


mrequency of Color-Tone Matchings on the Criterion Trial by Nationality 


Colors 


Red 


Yellow 


Orange 


Green 


Blue 


(Column 


Sums Jj 


Red 


Yellow 


Orange 


Green 


Blue 


(Column 


Sums ) 


(Relative frequencies are shown in paratheses) 
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Tones Row Sums 
Se. 200 750 1000 1500 
DO e 
5 Í í Ne I 30 
(083) Moor) (.047) (Cio) (10) (.20) 
> 2 E 3 LL 30 
392) (2013) os) (.06) (.073) (207 
2 5 8 12 B 30 
Gers) (033) .053) (.08) (.02) (eo) 
4 15 8 2 O 30 
ec NOD 1953) (oe (.00) Que 
ne 7 2 h Í: 30 
er 07) ous) 027) Bee 
30 30 30 30 30 150 
(.20) (.20) (220) 20) inco» (1) 
Indonesians 
C 2 2 O 6 10 
(.00) on) (.oh) 00) es) (.20) 
O O 3 3 h 10 
.00) ( .00) ( .06) (.06) (.08) (26) 
a i 3 6 O 10 
00) (.02) ( .06) mu (.00) (20) 
3 Ly 2 i Q Ure 
(.06) (.08) (OR) (.02) (.00) (.20) 
T 3 O O O 10 
(.14) (.06) 08) ( .00) (700) (.20) 
10 10 10 O 10 50 
(.20) (.20) quee) (.20) ee) I 





Table 4 Continued 


Colors Tones Row Sums 
379 500 750 1000 1500 
Koreans 
Red 2 il: al 1 > O 
mon (02) (.02) (.02) (10) (.20) 
Yellow 1 h 3 5 O 10 
G02) (.08) (06) ( . Ol) (.00) (.20) 
Orange L D | 3 J 10 
(.08) 0o) (.02) (.04) (.02) (20) 
Green l 3 3 2 L 10 
Moz) (.06) (.06) (EOR) (A02) (20) 
Blue 2 L 2 2 3 LO 
( .0h) 102) ( . Oh) ( .OH ) (.06) 1220) 
(Column 
Sums) 10 10 10 10 10 50 
(.20) (.20) (T20) (220p (F20) (1) 
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The relative frequencies in Tables 1 and 4 were trans- 
formed to information measures in bits and used to calculate 
the information transmitted per trial for all subjects and 
by nationality. Table 5 contains the information quantities 
for the color-tone matchings on the criterion trial for all 


subjects and by nationality. The following information 


Measures are listed in Table 5: (1) input information, H(X); 
en Output information, H(Y); (3) eme information, H(X,Y); 
mee ansmitted information, T(X,Y); (5) noise, H(Y|X); and 
(6) equivocation, H(X|Y). The amount of transmitted informa- 


tion was calculated by summing H(X) and H(Y) and subtracting 
H(X,Y). Noise, H(Y|X), was calculated by subtracting T(X,Y) 
from H(Y), and equivocation, H(X|Y), was calculated by 
subtracting T(X,Y) from H(X). The amount of transmitted 
information was used as an index of consistency with which 
tones were matched to colors using subjects as a group, not 
as individuals. Perfect transmission would mean that know- 
ledge of the response (i.e., tone selected) would yield 
knowledge of what color had been presented. The value of 
transmitted information inaperfect transmission task would 
be 2.32 bits. Analysis of the reSults in Table 5 indicated 
that the Indonesians had approximately twice as much trans- 
sed untormdtion (.86 bits) as did the U. S. Officers 


(-40 bits) and approximately 3.5 times as much as the 


ES detailed discussion of information contingency tables 
and calculations appears in Appendix C. 
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Koreans (.26 bits). The results indicate different amounts 
of information transmitted by nationality, although all 
amounts were less than one bit. 

In order to evaluate the sources of noise in the data, 
conditional response distributions were calculated for each 
color. Table 6 contains the noise source evaluation by 
color for all subjects and by nationality on the criterion 
Meal. Each conditional probability was transformed to 
information in bits and these values were summed across 
each row to obtain the amount of noise (bits) per color. 
The occurrence of noise resulted from the tendency of a 
img le stimulus to elicit several different responses. The 
amount of noise per color measured the variability in the 
responses not correlated with stimuli variability. The 
colors associated with the lower amounts of noise indicated 
that subjects tended to match tones more consistently for 
them, i.e., there was less variance. Colors associated 
with the larger noise values indicated that subjects were 
not consistent in their matching process. The frequencies 
associated with the conditional probabilities in Table 6 
were used to perform a one-sample Chi-Square test (Siegel, 
MSG pp. 42-46) in order to evaluate the statistical sig- 
nificance of the distributions. The Chi-Square values of 
the response (tone) distributions were evaluated agalnst 
the hypotheses that expected tone responses would be evenly 
matched for any color. The expected frequencies per cell 


for the Indonesians and Koreans were less than five, but 
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Table 6 
Noise Source Evaluation by Color for All Subjects and by Nationality on 
chesemsiterion Trial 
(Conditional probabilities in rows) 
Colors Tones Noise(bits) 


> 200 190 1000 1500 


A11 Subjects 


Red lh . 08 .20 .06 52 1.89 
Yellow .08 MES .22 128 .30 EET 
Orange ES a .2h 42 . 08 2.08 
Green .16 hh . 26 ge Ue 193 
Blue so . de 2 EO 1398 


IESO TESIS 


Red s .03 mee or 150 1.84 
Yellow NO x19 Lar 30 B 2.09 
Orange Mo Eur 2 . HO s10 oni 
Green LIES 519, . LO . 00 Jo 
Blue 253 23 SOT IE us 78 
Indonesians 
Red „oo 220 .20 100 „60 m 
Yellow . 00 „oo 30 . 30) „ho Sr 
Orange CO ale 220 . 60 „oo 1.30 
Green 50 ‚ho „20 Eu ¿00 J 
Blue tO .30 „oo 06. .00 .38 
Koreans 
Red .20 sale, TO .10 NE 1.96 
Yellow ¿LO „Lo 30 .eQ BOO 1.85 
Orange SO MN „10 . 30 LO 2.05 
Green ~ LO -30 30 220 10 Zn 
Blue 20 E ¿20 new 120 2.25 
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the nature of the noise source evaluation did not allow for 
additional combinations of some of the classes to increase 
expected frequencies. Since, however, there were more than 
two degrees of freedom and the expected frequencies per 
cell were equal to two, Chi-square values were calculated 
for the Indonesians and Koreans as rough approximations 
(Walker and Lev, 1953, p. 107). Chi-square values greater 
Ran the critical value of 9.5 toas a Signficant depar- 
mire irom a uniform distribution of tones for those colors. 
In addition, the Chi-square values for the Americans and 
group (all 50 subjects) responses for the color yellow 
suggested a strong association of the color yellow and a 
Peet@eular sound did not exist. The results are listed in 
Table 7. 

In order to assess the effects of reducing the noise 
source, the task was transformed to an information reduction 
task using only two categories, high (1000 and 1500 Hz) and 
low (375 and 500 Hz). The 750 Hz tone was excluded. The 
stimuli remained classified into five categories. Table 8 
contains the results of this noise reduction analysis for 
all subjects and by nationality. The Chi-square independent, 
k-sample test (Siegel, 1956, pp. 175-179) was used to evaluate 
the noise reduction. Chi-square values for all 50 subjects 
and by nationality were computed. However, the expected 
frequencies for the Indonesians and Koreans were less than 
five but greater than two. The Chi-square values for these 


nationalities are their approximations. The contingency 


74 





Table 7 


Chi-Square Values of Response (Tone) Distributions for Zach Color by All 
subjects and by Nationality 


Chi-Square 

Solors Koreans Indonesians Americans All Subjects 
Red 6.0 12.0 20.6 © 
Yellow DE mo OO 9.4 
Orange O 13.0 eee enc 
Green 2:0 O e — 
Blue 1. O 13,0 es Or 31.1 
Chi-Square at a .05 level with four degrees of freedom = 9.5 


> 








Borrrieient, (C) (Siegel, 1956, pp. 196-202), was computed 
for the appropriate Chi-square values in order to measure 
the degree of association between the variables of color 
and two sound categories. However, the contingency coeffi- 
cient is not comparable to other correlation measures. 

With the exception of the Korean subjects, the results of 
the noise reduction were significant beyond the .001 level. 
The Chi-Square value for the Koreans (Chi-Square = 3.04) 
indicated that the color and tone combinations were 
independent. Some Chi-square values in Table 8 were larger 
than those values in Table 6 indicating that reduction of 
response categories increased the association of a parti- 
cular color with a combination tone. This result was 
expected. A strong color-tone dependency existed except 
as noted above. 

Analogous to the response (noise) reduction reported 
above, colors were combined to reduce the equivocation 
possible in the task using all five-tone categories, ease 
above, became a stimulus amplification task. Analyses 
of the response distribution for the combined color signals 
for all subjects and by nationality appear in Table 9. The 
one-sample Chi-square test was used to calculate Chi-square 
values of the response distribution. The Chi-square was 
evaluated against the expected hypothesis that tone choices 
would be evenly distributed for any color-combination. The 
expected frequencies for the Indonesians and Koreans was 


less than five (i.e., four); however, it was assumed that 
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Taple g 


Noise Reduction by Reducing Responses to Two Categories (High, Low) for 
All Subjects and by Nationality} 


Solor Tones Row Sums 


High Low 
(1000, 1500) (375, 500) 


All Subjects 


Red 29 T lo 

Ee Tow 29 10 39 

Orange 25 13 38 

Green [ 30 S 

Blue LO 36 L6 

(Column Sums) 100 100 200 
Chi-Square = 50.4 

Contingency Coefficient = .448 


oe Orr leers 


Red i 6 23 
Yellow 20 5 29 
Orange aks, 7 ee 
Green E 19 pla 
Blue 5 23 28 
(Column Sums) 60 60 120 
Chi-Square = 40.36 


Koneinseney Coefficient A15 


ll 


Ls 





Table 8 Continued 
MOTors Tones Row Sums 


High Low 
(1000, 1500) 000500) 


Indonesian Officers 


Red 6 2 8 
Yellow m" | z n 
Orange 6 | l T 
Green n 7 8 
Blue E 10 10 
(Column Sums) 20 20 ho 
Enw-oqguare = 27.07 

Contingency Ccefficient = .635 


Korean Officers 


Red 6 3 9 
Yellow 2 5 7 
Orange L 5 9 
Green 3 L T 
Blue 5 3 8 
(Colum Sums) 20 20 hO 
Chi-Sauare = 3.04 

Contingency Coefficient = .265 


E 
t 

= 
(D 
Q 


pa 
I 
C1 


quare value at & .05 Level with four degrees of freedom 


es 


LST. 
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Pap ters 


Response Distribution for Combined Color Signals for All Subjects and 
by Nationality 


odor Tones Row Sums 
Combinations 


EIN 200 (50 1000 1500 


All Subjects 


Red-Yellow 11 10 21 j hl 100 
Red-Orange 13 11 22 24 30 100 
Yellow-Orange 10 13 23 2 19 100 
Red-Yellow-Orange 17 i 33 38 L5 150 
Green-Blue 33 ER D 12 5 100 
(Column Sums) 84 ah 116 126 1%0 


Ue oS. Orr icers 


Red-Yellow 8 3 1e d 26 60 
Red-Orange re 6 15 14 18 60 
Yellow-Orange 5 7 13 21 14 80 
Red-Yellow-Orange 10 3 20 23 29 90 
Green-Blue 20 22 LO z il 60 
(Column Sums) 50 L6 TO 76 88 


3 








x 


Dolor 
Combinations 


Red-Yellow 
Red-Orange 
Yellow-Orange 
Red-Yellow-Orange 


Green-Blue 


(Column Sums) 


Red-Yellow 
Red-Orange 
Yellow-Orange 
Red-Yellow-Orange 


Green-Blue 


(Column Sums) 


EIS 


10 


10 


24 


Table 9 Continued 


Tones 


900 (90 1000 1900 


iadonesian Officers 


2 2 3 10 
3 5 6 - 6 
jè 6 9 y 
3 8 9 10 
i 2 1 O 
16 26 28 30 


Korean Officers 


E 4 3 2 
2 2 y 6 
5 4 3 1 
6 5 6 6 
y 5 lh 4 
22 20 22 22 


80 


Row Sums 


20 
20 
20 
30 
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these cell frequencies would yield good Chi-square approxi- 
mations. These results (Table 10) show that the dependency 
of combined colors on tone responses is less than the 

dependency of some single colors and tone responses (Table 7). 

An equivocation analysis was conducted using color 
combinations red-yellow-orange and green-blue. The occur- 
rence of equivocation results from the tendency of subjects 
to make the same response to several different stimuli. 

Thus to analyze equivocation reduction, the number of color 
Ecnuj2 were reduced by grouping them according to the 
commonalities seen in the preceding analyses. 

The 5 x 2 contingency matrices were evaluated using Chi- 
Square and the results were highly significant for all 
Subjects and each nationality except for the Koreans 
(Chi-square = .833). Contingency coefficients were computed 
to provide an index of association between color combina- 
tions and tone responses. The row frequency data were 
transformed to bits uSing their relative frequencies. The 
information values were summed across each row providing a 
measure for the amount of equivocation in bits. The equivo- 
cation measured the tendency among subjects for several 
Stimuli to elicit one response. The high equivocation 
values (close to one bit) indicated the existence of 
considerable uncertainty in matching a certain sound to 
particular color combinations, but there was considerable 


variability among tones and nationalities. The equivocation 
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raporte 10 


Chi-Square Values for the Association of Color Combinations and Tones for 
All Subjects and by Nationality 


Chi-Squaret 


oM Koreans Indonesians US OTi eers ll pubjecbs 
Red-Yellow 1.0 mS. 24.5 31.6 
Red-Orange D SN 9,16 12.5 
Yellow-Orange 2.0 10.5 Tos 19.2 
Red-Yellow-Orange os 12,2 I zZ 
Green-Blue 250 10.5 oe 31.8 


1. Chi-Square was evaluated against the expected hypotheses that tone 
choices would be evenly distributed for any color combination. The 
critical Chi-Square value with four degrees of freedom at the .05 level 


was 9.5. 
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values were largest for the Korean subjects which provided 
an additional indicator of the lack of agreement present 

in the matching process for these subjects. The low equivo- 
cation values for the U. S. Officers and particulary the 
Indonesian Officers indicated consistent matchings existed 
for particular color combinations and tone responses. 
Equivocation results are provided in Table ll. 

Ac penal Grouping Of color combinations and tone 
combinations for all subjects and by nationality was 
obtained by selecting the color combinations and tone 
combinations with the larger Chi-square values computed in 
previous analyses (Tables 8 and 10). These optimal groupings 
are listed in Table 12. Chi-square and contingency coeffi- 
cient values for these optimal color and tone combinations 
are summarized in Table 13. The results indicate highly 
significant dependence among color and tone combinations 
for the U. S. and Indonesian subjects. The grouping for 
the Korean subjects (Chi-square = .477) indicated that the 
color and tone combinations were highly independent. Figures 
12 throuch 15 contain graphical representations of highly 
significant tone choices for red-yellow and green-blue color 


combinations for all subjects and by nationality listed in Table 10. 


Bee T DT SDS TO CRITERION 
The frequency distribution of trials to criterion for 
all subjects and by nationality is shown in Table 14. A 


fixed effects, one way analysis of variance for unequal 
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fap lesa 


Ber ıscarıon Reduction by Combining Color Signals for All Subjects and 
by Nationality 


Tones Color Combinations Equivocation Row Sums 
(cats) 
Red-Yellow- Green-Blue 
Orange 


All Subjects 


> Dd Ds i eo 50 
500 D 33 1925 50 
750 BS p 925 20 
1000 38 12 .795 50 
1500 45 5 469 50 
(Column 

Sums ) 150 100 


On =Sdquare = 53 
Contingency Coefficient = .418 


Uomo Ortacers 


375 LO 20 .915 30 
500 8 22 ahi 30 
750 20 10 No 30 
1000 23 7 Uno 30 
1500 29 i -194 30 
(Column 

Sums ) 90 60 


Chi-Scuare = 43.6 


Contingency Coefficient = .475 
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Table 11 Continued 


fones Color Combinations Equivocation 
Pirs) 
Red-Yellow- Green-Blue 
Orange 
Indonesians 

319 O 10 O 
200 3 j oe 
150 8 2 . 
1000 9 r . 469 
1500 TO O O 
(Column 

Suns) 30 20 
Chi-Square = 30.93 
Contingency Coefficient = .617 

Koreans 

Bio 7 3 . 889 
500 6 4 moral 
730 2 2 1.000 
1000 6 h G71 
1500 6 h SL 
(Column 

Sums ) 30 20 


Chi-Square = .833 


Contingency Coefficient = .128 
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Row Sums 


TO 
LO 
10 
10 
LO 


10 
LO 
Le 
10 
10 








Tar besa 


Optimal Grouping of Color-Combinations and Tone Combination for All Subjects 
and by Nationality 


olor 
Combination Tones Row Sums 

High Low 

(1000, 1500) (3155500) 
AL SeRgeets 

Red-Yellow 58 2] 79 
Green-Blue DST 66 83 
(Column Sums) 75 87 


Uns seorTticers 


Red-Yellow EU iL 48 
Green-Blue 8 h2 50 
(Column Sums) 45 2 
Indonesians 
Red-Yellow I> 2 15 
Yellow-Orange 13 O I3 
Green-Blue 1 17 18 
(Column Sums) 27 IE 
Koreans 

Red-Orange 10 8 18 
Yellow-Orange 6 10 16 
(Column Sums) 16 18 


86 






Table 13 


Chi-Square and Contingency Coefficient Values for the Optimal Grouping 
of Color Combination and Tone Combination for All Subjects and by 


Nationality 
Subjects Chi-Square* 
All Subjects 43.48 
Wee o>. Officers 34.38 
Indonesians? 34.93 
Koreans .477 
1. The critical Chi-Square value with one 
.001 level is 10.38. 
2. The critical Chi-Square value with two 
.001 level is 13.82. 
33 


Contingency 
Coefficient 


.46 
a 
-66 


~ 103 


degree of freedom at the 


degrees of freedom at the 


‚The upper limits of the contingency coefficient for a 2x2 and 


3x3 contingency table are .707 and .816 respectively. 
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Table 14 


Frequency Distribution of Trials-to-Criterion by Nationality and by All 


Subjects 
NO. of Trials Indonesians Koreans emo. Oliieers All Subjects 
2 O O 5 5 
3 L O 5 6 
h 2 O 8 10 
5 1 2 6 9 
6 2 E 2 u 
T l O O l 
8 aL di 2 L 
9 2 E O Y 
10 O O 2 2 
L. O d O 1 
12 O ie O ii 
Mean 
Number of 
Trials to Criterion: ore et L.S oo: 
Variance of Number 
gi trials to 
ri erion: 4.54 ones 4.67 SS 
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Sample sizes (Winer, 1971, pp. 210-215), was used to deter- 
mine if significant differences in trials to criterion 
existed based on differences in nationality. The fixed 
effects model was used as military officers were assumed 

to be of a particular select group of the population of 
military officers of each nationality. Analysis of variance 
results are listed in Table 15 and indicated a significant 
Mac ference in trials to criterion based on a difference in 
Nationality. Contrasts of treatment means indicated that 
the Korean subjects’ average number of trials to criterion were: 
erfferent from the U. S. officers' average numbers of trials to 


criterion but not from the Indonesians’. 


C. LOUDNESS AND BRIGHTNESS SETTINGS 

The means and standard deviations of loudness level 
Settings per frequency appear in Table 16. The results 
indicated that the variability of reference tone of 
1500 Hz (at 80 dB SPL) due to inherent equipment and measure- 
ment error was not extreme and that the subjects' subjective 
loudness settings were consistent and reliably close to the 
equal loudness contour of 80 phons over the frequency range 
375-1500 Hz at a 80 dB loudness level. 

The means and standard deviations of photometric bright- 
ness settings for each color are summarized in Table 17. 
There is considerable variability within the observed mean 
values. The colors yellow and orange were matched for 


brightness across a large range of values whereas the 


ES 





Table 15 


Analysis of Varinace of Trials-to-Criterion by Nationality and Contrasts 
Contrasts of Treatment Means 





Source q So MS F 
Nationality 2 81.92 40.96 8.27 
Error 47 232 4.95 
ka, Bf) at a .05 level = 3.20 
Contrasts of SSe F Der 
Treatment Means 

es 2 ons 2.59 OS 

SS 19.25 3.89 

2s 3 76.8 19.3 
y L = 
tical (1,47) at a .05 level ms 
L. Treatment 1: Indonesians 


2: Koreans 


Cee eo ee tree 
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Means and Standard Deviations of Loudness Level Settings per Frequency 


Frequency (Hz) 


Eo 
500 
120 
1000 
1500 


Mean 


Sra. Dev. 


Table 16 


Average (dB) 


72.62 
72.48 
74.46 
72.84 
79.46 


74.37 
= 


J5 


Standard Deviation (dB) 


5.04 
6.70 
6.30 
21955 
TOS 


4.96 
2. 3 








lo 


Means and Standard Deviations Photometric Brightness Settings for 


Hace Color 

Color Mean (fc) Standard Deviation (fc) 
Red po of 

Yellow 4.10 4.47 

Orange 3.78 | 5,02 

Green el 2 

Blue LeS ‚0913 

Mean 3.46 2.32 

Std Dev. 2.49 2.30 
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colors red and green were matched for brightness across a 
much smaller range. Except for the standard color blue 
this suggests that differences in saturation do not 
influence the degree to which colors are considered equally 
bright, i.e., colors orange and yellow appear brighter than 
red and green regardless of differences in saturation. The 
color red had the largest photometric brightness mean value 
and a relatively small standard BEI as compared to 
the respective values for the other colors, i.e., yellow and 
Seance. This indicated that the color red required the 
largest amount of intensity to make it appear equally bright 


m er other colors. 


EE 








. IX. DISCUSSION 


The interpretation of information measures calculated 
in this experiment was based on information theory terminol- 
ogy for a discrete bivariate information channel described 
in Sheridan and Ferrell (1974). Interpretation of the 
information matrices for this study indicated a general 
Ber or eonsistency and lack of perfect transmission in the 
presence of large amounts of noise and equivocation. 
Analysis of the information measures indicated that on the 
criterion trial the Indonesian subjects transmitted twice 
the amount of information as did the Americans and about 
3.5 times the amount of the Korean subjects. Significant 
learning trends based on information analysis were non- 
existent yet analysis of variance results indicated the 
number of trials to criterion were affected by a difference 
in nationality. The Korean subjects' average number of 
mals to criterion were significantly different from the 
American subjects' but not the Indonesian subjects’. 

Results of one-sample and independent sample Chi-square 
tests indicated dependent associations of color and tones 
(singly and in combination) existed and were affected by 
differences in nationality. The colors yellow and red 
were frequently grouped with the tones 1000 and 1500 Hz 
as were the colors blue and green with tones 375 and 500 Hz. 


No significant dependence existed for the Korean subjects. 
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Contingency coefficients were computed to provide an index 
of association between color and sound although this coeffi- 
cient is not comparable to other measures of correlation. 

The noise and equivocation analysis provided a method 
by which the amount of inconsistency in the matching process 
could be analyzed. Noise measured the tendency of a single 
stimulus giving rise to different responses, i.e. noise 
measured the variability in responses not correlated with 
the variability in stimuli.  Equivocation (lost information) 
measured the tendency for a single response to result from 
several stimuli, i.e., it provided a measure of the vari- 
ability in the stimuli which did not correlate with the 
variability in the responses. 

The lack of consistency observed in this study is best 
explained as follows: the objective of this experiment was 
to determine if there was a natural association of color 
and pitch common among military officers of three nationali- 
ties. The objective was not to have subjects response to 
Stimuli as if specific color-pitch associations had been 
learned and reinforced by practice sessions. The number of 
color stimuli and response tones was well within the recom- 
mended number of levels used in absolute judgment tasks 
using the dimensions of color and pitch. The selection of 
the five colors and five tones, over the frequency range 
375 - 1500 Hz, with octave spacing within the frequency 


range was based on human factors design criteria, previous 
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experimental investigations and the degree discriminability 
among the selected stimuli and responses. The mechanics 
of the matching response was not difficult yet the parti- 
cular association of color and sound used in this study 
may have been unfamiliar and confusing to many subjects. 
In addition, the subjective nature of the association and 
individual cognitive processes were considered to influence 
the variability in matching technique from subject to 
subject. Also, the results indicated that differences 
existed due to differences in nationality. The additional 
s DIOS Of Cultural conditioning, influenced the results. 
However, no quantitative criterion other than a difference 
in nationality, was used to meaSure the degree of influence 
of this variable. Some subjects may have had strong back- 
grounds in which colors and/or sounds were frequently used 
eee art, photography, music, etc.) and these differences 
may have contributed significantly to dependent color-sound 
associations. 

During the issuance of instructions the Korean subjects 
(as a group) took the longest time to instruct. They had 
difficulty understanding the subjective meanings of the 
terms "feel," "intuitive," and "natural." They appeared 
uncomfortable in understanding nonstructured terminology 
Within the setting of this experiment. 

The E questioned each S after each experimental session 
to determine what reasoning was used in forming the color- 


sound matches. Five Ss stated that they made the match by 
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associating the spectral wavelength frequency with the tonal 
frequency. The majority of the Ss stated that the colors 
green and blue were mellow, calmer colors and associated 
these colors with the lower "mellow" pitches. Most Ss 
matched red with the frequency 1500 Hz, based on an opera- 
tional exposure to the association of a red emergency light 
with a high attention getting sound. Also, these same Ss 
stated that yellow and orange une matched 
with higher frequencies as they were close in spectral hue 
to the color red. Some Ss matched red with the middle 
frequency 750 Hz stating that the colors yellow and orange 
were lighter than blue and green and made the association 
of yellow and orange with the "lighter" sounds of the 
higher frequencies. In these cases the Ss stated the color 
red was used as a middle reference point. It was not 
surprising to find such a wide range of variation in 
Subjective matching strategies. 

The loudness level observations for each of the five 
frequencies indicated that each subject's was consistent 
with respect to the reference tone 1500 Hz. The Fi, 
statistic (Winer, 1971, pp. 206-207) was used to test for 
the homogeneity of group variances and the results were 
not significant (p > .05). The results of the t-tests of 
differences (Winer, 1971, pp. 27-35) comparing differences 
of the group mean loudness levers were not significante 
indicating that the group means (less 1500 Hz) were 


similar. The results of the photometric brightness 
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observations indicated the variances were different for 
the colors. This variability was anticipated based on the 
comments by Wyszecki and Stiles (1967) regarding the degre 
Seevariability involved in direct visual brightness 
matching techniques using different colors. 

Inspection of the results in Table 1 suggest an approxi- 
mate one-to-one spectral tone correspondence existed in the 
matching process. The frequencies in each row were trans- 
formed to percentage values and the higher percentage 
values associated with a particular color-sound match 
indicated that the lower (higher) light frequencies were 
associated with the lower (higher) sound frequencies. These 


results are summarized as follows: 


Color Percentage of Ss Selecting a Wavelength Frequency 
Frequency with a Designated Color (in nm) (Hz) 
Red 52 631 1500 
Orange 42 595 1000 
Yellow 30 579 1500 
yellow 38 579 1000 
Green 44 536 500 
Blue 70 477 575 


This observed spectral-tone association resulted from 
the data, however, the objective of this study was not tO 


investigate such an association. 
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The results obtained in this experiment differed from 
eae results obtained by Simpson, Quinn and Ausubel (1956). 
These authors plotted percentages of Ss selecting six 
different frequencies for which color choices were made. 
The graphical representations of the percentage data computed 
in this study were quite dissimilar compared to the results 
of Simpson, Quinn and Ausubel (1956). However, among the 
relationships of color and sound, two were of particular 
interest with regard to this present study. These authors 
found a relationship of the color yellow with 8000 Hz and 
the color blue with 125 Hz. The results of this present 
study indicated the color yellow tended to be associated 
with the frequency range 1000 - 1500 Hz and the color blue 
with the frequency range 375 - 500 Hz. It appears that the 
Spacing along the frequency dimension did not affect the 
color-sound associations using the colors yellow and blue. 
It should be noted that Simpson, Quinn and Ausubel (1956) 
tested 995 children using sound as the stimuli and color 
as the response and the frequency range was 125 - 12000 Hz. 
The percentage of Ss selecting colors for designated sounds 
was much smaller than the percentages values and range of 
percentages obtained in this present study. This comparison 


is illustrated below: 
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Color Range of Percentage Points Difference in Percentage 


Points 
Red l eee 8 
Orange 14-20 6 
Yellow Ger 16 
Green PZ 9 7 
Blue 20-28 18 
Violet 2923 T 


Differences in percentage points for 50 Ss in this Study 


were as follows: 


Color Range of Percentage Points Difference in Percentage 
Points 

Red 6-52 46 

Yellow 8-30 22 

Orange 8-42 34 

Green 2-44 42 

Blue 8-50 42 


These differences may be partly attributable to the differ- 
ences in stimuli presentation, sample size and specific 
experimental conditions between these investigations. 

The experimental results of this study indicated that 
certain sounds were associated more frequently with certain 
io E han with other colors. The amount of information 
transmitted in this task was minimal. Analysis of the data 


Suggested that this association of color and sound may be 
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combined with functional requirements in an information 
display environment to promote Ses coding and improve 
Operator performance behavior. These auditory and visual 
dimensions could be used as supplemental coding variables 

in increasing the degree of accuracy in identification and 
location tasks and could be combined to enable the operator 
to process more information, once the consistent association 
of color and pitch had been learned and reinforced with 
practice sessions. A universal natural association of 

color and sound may not exist but within the specific 
experimental conditions of this study certain color-sound 
associations existed among two of three nationalities. 
Knowledge of these results may improve training techniques 
in teaching operators to associate these coding dimensions 
and subsequently improve operator efficiency in information 
processing. 

Suggestions for further experimental investigations 
would be to evaluate the information transmission perform- 
ance and reaction times using the dimensions of color and 
pitch singly and in combination, based on a learned associ- 
ation of these auditory and visual dimensions. In addition 
to using pure tone frequencies, warbling tones masked in 
white noise could be used as sound stimulus or responses 
simulating sound signal transmitted in an operational 


environment. 
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X. CONCLUSIONS 


This experiment was designed to determine if there was 
a natural association of color and pitch among military 
officers of three nationalities. The analyses of the 
experimental data indicated that the amount of transmitted 
information was less than one bit when the maximum possible 
was 2.32 bits for all nationalities yet there was a signifi- 
cant difference in the amount of information transmitted 
per nationality. The Indonesians transmitted .86 bits, 
the Americans transmitted .40 bits and the Koreans transmitted 
.26 bits. The Korean subjects' average number of trials to 
criterion was significantly different from the American trials 
but not different from the Indonesian trials to criterion. 
Mer results of color combination and tone combination 
analyses indicated that significant association of color 
combination and tones existed for the American and Indonesian 
subjects, but did not exist for the Korean subjects. 
The color combinations red-yellow were associated with 
frequencies 1000 and 1500 Hz; the colors green-blue were 
associated with frequencies 375 and 500 Hz. Interpretation 
of the information matrices indicated a general lack of 
Consistency and lack of perfect transmission in the presence 
of large amounts of noise and equivocation. 

Within the conditions of this experiment there was a 
e natural association of color and sound for the 


Indonesian and American subjects. 
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APRENDE A 


DEFINITION OF TERMS 


A. GENERAL 

s sc purposes of clarity and uniformity, the color 
and sound terminology used in this study conforms to a 
series of definitions provided by the Committee on Colori- 
metry of the Optical Society of America (1953), and 
referenced in Stevens (May, 1966) and Richards (1976). 

Basic colorimetric concepts are expressed in psycho- 
logical and psychophysical terms. Psychological concepts 
eR Olor refer to color perceptions. The color terms which 
apply to these concepts enable an observer to describe his 
perceptions.  Psychophysical concepts of color refer to 
the color-matching of one photometric field with another 
and to judgments of similarities and degree of differences 
between photometric fields. The following definitions are 
basic and of the most general use. The psychological and 
psychophysical distinction is not stated in each definition, 
however, it should be remembered in referring to these 
general concepts. A parallel distinction must be made with 


the auditory terms as well. 


Be DEFINITIONS 
l. Color: The relation between radiant energy and 
visual sensation is described by the OSA Colormetric 


Committee as "that aspect of radiant energy of which a 


107 





a human observer is aware through the visual sensations which 
arise from the stimulation of the retina of the eye." The 
aa eal characteristics of light which provide the basis 
for color are specified in terms of (a) photometric magnitude 
(luminance), (b) dominant wavelength, and (c) wave length 
purity. These physical characteristics correspond to the 
three primary attributes of visual sensation -- brightness, 
hue and saturation. 

2. Brightness: Brightness is the quantitative aspect 
of the mental image and describes the image appearance in 
terms of its apparent amount. In a general way, brightness 
increases with the physical intensity of the light producing 
it. If a single spot of light appears in a field of view 
and it increases (decreases) in amount without changing its 
spectral energy distribution, it will appear brighter or 
dimmer. 

Sues Hue can be described as the main quality 
factor in color and permits colors to be described as red, 
blue, yellow, green, etc. It is the most noticeable factor 
that changes in the spectrum as the wavelength of light 
changes. 

4. Saturation: Saturation is related to the amount of 
white a color appears to contain; the less white, the higher 
the saturation. Of the three color attributes, saturation 
and hue define what may be called the quality aspect of 


a mental image caused by light. 
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2. Chromatic and Achromatic Colors: Colors may also 
be divided generally into two distinct classes: chromatic 
and achromatic, depending on whether they do or do not 
exhibit a hue (e.g., black, gray or white are termed 
memmeomatic colors). 

6. Color Mixture: The visual mechanism, unlike the 
ear, does not analyze light into its component frequencies. 
The fundamental concept upon which color specification is 
based, is that any given color can be matched by addition 
(subtraction) of a combination of three properly selected 
light sources of different wavelengths. The primary colors 
(red, green, blue (or violet)) are the three most often 
chosen reference lights by whose additive mixture nearly 
all other colors may be produced. Once these components 
are selected, the entire color spectrum can be produced by 
adjusting the relative amounts of the three components; the 
relative amounts of these primaries are Called the tristimulus 
values of a color. 

7. Dominant Wavelengths: The dominant wavelength of a 
oo is Ene wavelength of the spectrum color. This corre- 
lates in an approximate way with what would be called the 
hue observed under every day conditions. In general, colors 
of a constant dominant wavelength perceived under similar 
conditions would be said to have the same hue. When dominant 
wavelengths are proportionately mixed (added) with a speci- 


fied achromatic color, a match is produced with the color 
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being considered. Two colors are complementary when they 
can be mixed proportionately to produce an achromatic 
experience. Every color has a complement (e.g., red and 
green, blue and yellow). 

Sumo DEcrfrcation of Chromaticity: The specification 
of a color stimulus in terms of dominant wavelength and 
purity but not luminance is known as a specification of 
chromaticity.  Chromaticity coordinates are the ratios of 
each tristimulus value of the color to their sum and plotting 
these coordinates yields a point on the diagram. A chroma- 
ticity diagram iS one in which each point represents the 
chromaticity of a color independent of its luminance. 

EMEN cucationoPurity: The excitation purity of any 
color possessing a dominant wavelength is an exactly defined 
ratio of distances in the chromaticity diagram, indicating 
how far the given color is displaced from the achromatic 
Aaa towards the spectrum color. Excitation purity corre- 
tes loosely with saturation of a color observed under 
un ru Observing conditions. 

An excellent color illustration of a chromaticity 
diagram is found in "Scientific American," September, 1968. 
Also, the color circle and color solid are abstractions 
that can be used to clarify statements and color attribute 
concepts schematically (Conover & Kraft, 1958; Evans, 1948; 
Jones, L., 1937; Judd & Wyszecki, 1975; Weintraub, 1966; 


Wyszecki & Stiles, 1967). 
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ieee sos Of Specifying Color: Colors can be specified 


by means of colorimetry or comparison with established color 
standards. 

a. Colorimetry: Instruments used for the direct 
measurement of light energy composition are called colori- 
meters. For making routine measurements the use of colori- 
meters has been superseded by indirect colorimetry, wherein 
the computation of tristimulus specifications is based upon 
photometric and psychological data. 

b. Photometer: A physical photometer is a photo- 
sensitive surface which receives incident light and from 
Which is drawn the electric current producing the instrument 
response. The response of a physical photometer is absolute 
and readings on different occasions are comparable. They 
are convenient to use and are built to give a high precision 
of measurement. Numerous photoelectric illuminance photo- 
meters of different designs can be obtained commercially. 

A major disadvantage is that the photocurrent generated 
for a given illuminance varies greatly with the angle of 
incidence of the light on the photosensitive surface 
(Wyszecki & Stiles, 1967). 

c. Color Standards: Color standards are usually 
members of a systematically arranged set of pigmented or 
dyed surface (color patches) and are used for making visual 
Comparisons with material whose color is to be specified. 


The Munsell System is representative of several specification 


TEL 








methods using opaque, reflecting color standards. The 
International Committee on Illumination (CIE) color speci- 
fications have been published for typical sets of Munsell 
codes. Kodak Wratten Filters are used as well for a wide 
variety of photographic, scientific, and technical work. 
The standardization of each filter for color and spectral 
transmission have been calculated and is rigidly maintained. 
several Kodak publications contain the applicable filter 
information. The Munsell Systems and Kodak Filters are 
widely accepted in industry, science and the military for 
mse as color standards. 

uM wE:cund: The basic concept for sound is that of 
pressure variation. Complex mechanical vibrations of air 
molecules transmit energy to the human ear and stimulate a 
sensation related to the physical sound. The simplest sound, 
a pure tone, consists of a single frequency of sinusoidal 
vibration; complex so-nds are called "noise" and come in 
a variety of forms. The most impure sound possible is 
called white noise. A pure tone has all its energy at one 
frequency, white noise has equal amounts of energy at all 
frequencies. White noise, like white light, can be 
separated into narrow bands and used to explore the proper- 
fies of the ear (Fogel, 1963; Stevens, 1975). 

CA cory Attributes: The auditory attributes of 
sound are pitch, loudness, volume, and density; these are 
dimensions of auditory experience and are all related to 


intensity and frequency. Yet distinctions between loudness 
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and intensity and between pitch and frequency have to be 
made. The intensity and frequency of a tone can be measured 
by an apparatus far removed from the listener; loudness and 
pitch are tonal attributes as heard and reacted to by a 
listener. Loudness and pitch are dimensions of an auditory 
experience, whereas, intensity and frequency are acoustic 
dimensions (Stevens, 1966). Pitch is the name given to the 
"highness" and "lowness" of tones; low (high) frequencies 
yield low (high) pitch tones as there is a rough correspon- 
dence between pitch and frequency. Loudness, in general, 

is determined by the physical intensity of a sound, or 
Magnitude of an auditory sensation. The volume of a sound 
refers to the size of the sound or how large it appears to 
be. The density of a sound refers to the compactness, 
concentration, or hardness of a sound. The relationships 

of these attributes to intensity best understood by referring 
to numerous graphical presentations available in the 
literature. The important idea is that pitch and loudness 
are names for separate subjective aspects of auditory 
stimuli (Geldard, 1972; Stevens, 1966; Stevens, 1975). 

13. Ambient Noise: Ambient noise is the background 
noise in a test environment. In most experiments dealing 
with audition, it should be kept to a minimum. 

14. Equal Loudness Contours: Equal loudness contours 
are functions which relate equal loudness sensations (in 
dB SPL) for different frequency sounds; the reference 


frequency against which all other frequencles are compared 
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ES 1000 Hz. The loudness level of the 1000 Hz tone is 
expressed in phons and is numerically equal to its sound 
pressure level (dB re 0.0002 SUIS Gale) (Stevens, 1975). 

15. Frequency: The frequency of pure tone represents 
the number of complete cycles (Hz) that the sound wave has 
passed through in a one-second time period. 

16. Loudness: The loudness of a sound is the psycho- 
logical percept of sound iene vos 

17. Loudness Level: The loudness level (in phons) of 
any frequency tone is equivalent to the sound pressure 
level (dB re 0.0002 dyne/cm*) of a 1000-Hz tone judged 
to be of equal loudness. A 100 Hz tone may have to be 
adjusted to a level of almost 70 dB SPL in order to equal 
the loudness of a 1000 Hz tone at a level of 60 dB SPL 
tte nardas, 1976; Stevens, 1975). 

18. Mel: The mel is an arbitrary unit used in the 
scaling of pitch sensation. A value of 1000 mels equals 
the apparent pitch of a 1000-Hz tone set to a loudness 
level of 55 phons (55 dB SPL). Mel scales relate pitch 
and frequency. 

19. Octave: An octave is a 2:1 or a 1:2 frequency 
range; 250 Hz and 500 Hz are an octave apart, while the 
difference between 250 Hz and 1000 Hz is two octaves. 

s roD: The pitch of a tone represents the psycho- 
logical percept of frequency; pitch is perceptual and 


frequency is physical. 
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21. Pure Tone: A pure tone 1S a sound wave which has 
a definite tonal quality; its wave form is sinusoidal. 

22. Audio-frequency Oscillator: An audio-frequency 
oscillator generates sinusoidal wave outputs over the 
frequency range 20 - 20000 Hz. They are considered a 


basic audiometric instrument for acoustic research. 


Additional terms used in psychoacoustic experimental 


environments are referenced in A. M. Richards, Basic 


Experimentation in Psychoacoustics, 1976. 
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APPENDIX B 
DESIGN PRINCIPLES FOR WARNING SIGNALS 
AND AUDIO-VISUAL PRESENTATION 

The following design principles for warning signals 
and audio-visual presentation are discussed to support and 
validate the selection of the parameters of color and 
pitch used in this study. These risa ee supplement 
those mentioned in the main body; they are some of the 
significant principles extracted from the several references 
listed at the end of this Appendix. The principles are 
Tasted according to typical demands for audio-visual presen- 
ation, Warning signal design, principles of vision and 


auditory presentation. 


A. TYPICAL DEMANDS FOR AUDIO-VISUAL PRESENTATION 

For certain kinds of responses, especially for urgent 
or critical situations, or unusual environmental conditions, 
simultaneous presentation of information through the eyes 
and ears would provide better control of operator behavior. 
These categories are listed as follows: 

1. Where great redundancy is desired: redundancy is 
sometimes essential to combat excessive noise. The greater 
degree of uncertainty, or more complex the information, 
the greater redundancy is necessary to maintain the effi- 


ciency of operator response. When faulty selection or 


116 





manipulation carries heavy command and/or Operational 
penalties, redundancy coding to promote early Warning and 
accuracy should be provided. 

2. For emergency warning: simultaneous stimulation 
through both sense channels may provide a greater overall 
effect upon behavior where it is urgent to attract atten- 
tion to a new situation or incoming message. 

3. Where environmental conditions handicap data 
presentation through either sense channel alone. 

These are some typical demands for dual sensory 
presentation. However, a logical projection would be that 
dual presentation may also enhance reaction time, in 
responding to a display panel and assist the operator in 
his decision making abilities. In addition, all of the 
sources consulted concluded that the combination of visual 
and auditory presentation iS more efficient than either 


sense alone. 


B. WARNING SIGNAL DESIGN 

A good warning device should break through and get the 
Pus T On Of a preoccupied or bored operator; it should teli 
him what is wrong or what action to take and allow continued 
attention to other duties if necessary. In order to help 
the operator know what is wrong, signal lights can be 
grouped in patterns (i.e., arranged in sequence). In 
selecting a signal for a particular application, the urgency 


of the situation, other operator duties and other warning 
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devices must be considered as the operator may become 
confused, neglect critical signals or be bothered by 
unimportant ones. Signal lights may also tell an Operator 
what to do by their location, color, or labelling; he must 
be looking in their general direction, however, to properly 
react to their stimulation. These lights may be used to 
Signal minor failures that do not demand immediate 
attention or can be used to indicate Operational status. 
These latter points consider that the operator would be 


less attentive than he would be for an emergency. 


SS AUDITORY PRESENTATION 

Hearing is omnidirectional and cannot be involuntarily 
shut off; auditory signals are better for calling attention 
to imminent danger or potentially dangerous situations. 
The auditory channel should be used as follows: 

l. To supplement overloaded vision when additional 
visual displays would be undesirable. 

2. When vision is limited or impossible, as working 
in the dark or under low illumination and when maximum 
visual sensitivity is required. 

3. When signals must be distinguished from noise, the 
ear is a very effective frequency analyzer. 

4. When information must be presented independently 
of the orientation of the head, a person's duties may 
require him to move about or turn the head, whereas, 


visually presented information may be missed. 
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5. Auditory warnings are excellent "break L lirough” 
Beyices for getting the attention of a busy, bored, or 


fatigued operator. 


6. Tonal Signals could be used under the following 
conditions: 
a. The listener has special training in determining 
the meaning of a modulated signal. 
b. The Signal calls for immediate action. 
c. The signal (message) is extremely simple. 
d. Security of the message is important as speech 
1s easily understood by unintended listeners. 
7. Operators cannot correctly identify more than a 
few (3-5 Categories) of different intensities or pitches 
in absolute judgment tasks. 
8. Intermittent or repeated changes should be used in 
a Signal rather than a single change followed by a continu- 
ous Signal as the ear is much more likely to detect a 
change occurring every few seconds. 
9. Pitch differences represent high or low (up or down) 


as people speak of high or low pitch. 


D VISUAL PRESENTATION 

Visual presentation should be used as follows: 

l. If the task requires simultaneous comparison, quick 
selection from a large number of alternatives, or scanning 


maes, displays, etc.). 
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2. When the operator remains in a relatively 
stationary poSition. 

3. When the receiving location is too "noisy." 

4. When the number of display lights should be no more 
than eight for absolute discrimination. 

>. When brightness levels are used as coding dimensions 
the levels should be three to five times brighter than 
ma rounding lights. 

6. When hue is used it is a more easily identified 
dimension and location time is short for coding purposes. 
For brightness, poor contrast will reduce visibility of 
weaker Signals. 

7. Colored lights may always be referred to over time; 
whereas, continuous sounds may become quite annoying to an 
operator. 

8. A flashing light has a higher attention value but 
is more disturbing to a viewer; these types should be used 
for urgent warnings. 

The choice of the most effective signal color in a 
Specific situation is largely a function of background 
constrast, amount of ambient illumination and stimulus 
color. Personal preference for certain colors have to be 
considered as well. As Jones (1962) noted, blue-green 
colors seem to produce great identification variability; 
yet, most people prefer hues in the blue-green region in 


an operating environment. These principles and design 
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considerations are a synopsis of those principles referenced 
in the literature consulted for this study (Barker & Krebs, 
1977, USAF Design Handbook DH 1-3, 1972; Cheatam, 1950; 
Christ, 1975; Henneman € Long, 1958; Jones, 1972; McCormick, 
1976; Morgan & Cook, 1963; Mowbray and Gebhard, 1958; Mudd, 


1961; Reynolds & White, 1972). 
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APPENDIX C 


INFORMATION MEASUREMENT TECHNIQUES 
USED TO EVALUATE EXPERIMENTAL DATA 


A. GENERAL 

One of the objectives of this experiment was to explore 
the information measures associated with the cross-modality 
match of hue and pitch, and to een if transmitted 
information was significantly affected by a difference in 
nationality. The conceptual model used to record and 
display the statistical relationships of input and output 
is discussed in Sheridan and Ferrell (1974) and Fitts and 
Posner (1967). The model characterizes the input-output 
relationships as bivariate discrete information channels. 
This concept is particularly useful in studying stimulus- 
response behavior as it refers only to the statistical 
association of input and output, and not to the perceptual 
mechanisms that relate them. A common method of analyzing 
bivariate channels is to use a contingency table. In this 
experiment the rows corresponded to the input and columns 
to the output. The cell elements are probabilities 
indicative of the input-output association. In addition 
to experimentally evaluating the input-output relationship, 
the information measures of transmission, noise and 


equivocation will be discussed. 
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B. INFORMATION MEASURES ASSOCIATED WITH A BIVARIATE 
DISCRETE INFORMATION CHANNEL | 


ED this section the information measures used to 
evaluate the consistency of input-output (color-frequendy) 
associated will be discussed. During this experiment 
each S was presented each of five colors (stimulus), 

X; (1 = 1,2,3,4,5). For each presentation the S responded 
in one of five possible ways by matching a sound (response), 
Y; (j = 1,2,3,4,5) to the presented color. Each color was 
presented N times until a consistent matching of two 
consecutive trials was obtained (Section VII contains a 
description of the experimental procedure). The experimental 
data was represented in a contingency table illustrated in 
Figure 9. The number nij was the number of event pairs 

in which X, was the input and Y, the output. The number 

N was the total of N event pairs which was observed. The 
probabilities required for the calculation of information 
measures were based on sample relative frequencies entered 
into the contingency table and used to calculate the follow- 
i tTormation measures: input information, output 
information, transmitted information, noise, and equivo- 


Cation. A brief description of these measures follows: 


1. The average of the transmitted information asso- 
ciated with the occurrences of an event was computed as 


follows: 


A 








4 
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The measure H(z) was called the information content of 
set Z, i.e., the information conveyed on the average when 
a number of set z was specified; Pi is the probability 


Associated with the occurrence of the event in Set Z. 


2. The input (stimulus) information as determined by 
the E was defined as H(x). The probability associated 
with the event x, was expressed by the following relative 


frequency: 
n; n; 
p (x; ) = N. = ) E 
J 


The amount of input information was obtained by adding the 


contingency table (matrix) row marginals. 


3. The output (response) information as determined 
by the S was defined as H(y). The probability associated 
with the event we was expressed by the following relative 


frequency: 


The amount of output information was obtained by adding 
the matrix column marginals. 


4. The information associated with the joint occurrence 
of the input and the output or the number of times each 


response occurred for each stimulus was defined as H(x,y). 
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This information measure was obtained from- the matrix 
cell values. The probability associated with this Jogsmte 


Occurrence of events x; and Y; was expressed as the following 


relative frequency: 


| EE 
E ED N 
2. The amount of information transmitted was defined 


as T(x,y) and calulated as follows: 
DEDI HOCH OV HI) 


n he Input information is equal to the transmitted 
information which is in turn equal to the output information, 
the information channel is perfect. For example, if an S 
responded as instructed, making no mistakes, the S acted 
as a perfect channel, i.e., given the S's response, the 

E Can be certain of the stimulus that elicited it. How- 
ever, an S can make mistakes by pairing his response with 
stimuli differently from the manner required of him and 
peer transmit all the information. In this case, the 
results are insensitive to "correctness" of responses 

and are a function only of the consistency with which 
responses are paired with stimuli. Furthermore, input 
and output information may be equal, but information 


measures of equivocation and noise may exist. 
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6. The equivocation is the information about the DUE 
et x that might have been transmitted but was not. When 
many different inputs tend to result in a Single output 
there is a loss of information and the input is equivocal 
(lost information). The amount of equivocation was defined 


as H(x|y) and expressed as follows: 


H(x|y) = H(x) - T(x,y) 


7. When the same input leads to different outputs on 
e erent ocasions there is a variability in the ONDE 
which does not correspond to the variability in the input, 
this is noise. Noise is something other than the input 
which is added to the transmitted information. The amount 


of noise was defined as H(y|x) and expressed as follows: 


HE AS y) 


Sheridan and Ferrell (1974) provide matrix examples and 
schematic illustrations to explain each of these information 
measures. Figure 10 illustrates the relationship of all 

the information measures associated with a bivariate 


discrete information channel. 


C. CALCULATION OF INFORMATION MEASURES 
The following sample of information measures calcula- 


tions is provided to describe the computations used in this 
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study. The data were obtained from two pilot 
Individual data results have been combined to 
the information transmissions associated with 
group. Figure ll illustrates the contingency 
representation of the experimental data. The 
are the total number of responses the Ss made 


Meme ve colored lights to the five pitches. 


test Ss. 
calculate 
this two-man 
table 

cell entries 
in matching 


The data 


entries in parentheses are the relative frequencies of 


H(x), H(y), and H(x,y). The experimental data has been 


calculated and 1S shown below: 


RR Sut (stimulus) Information: 


mee = 50.2 log, (1/.2)) = 2.32 bits 


b. Output (response) Information: 


lI 


H(y) 


+ (1/2 log,(1/.2)) 


lI 


2:40.43) —p 720 49) h r P= 
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2014 log, (1/.1714)) + 2(.2286 log. (1/.2286) ) 


2,30 Bits 











, 


C. Information of the joint occurrence of input and outout: 


Huc v) 


d. The 


in matching 


E, Y) 


e. The 


H(xly) 


Ee The 


H(ylx) 


X 
-— 


(.1428 10g,(1/.1428)) + 2(.057 log,(1/.057)) 
+ 2(.0286 log,(1/.0286)) + (.1714 log,(1/.1714)) 
+ 2(.1143 log,(1/.1143)) + (.086 log,(1/.086) 


DS. 2 log, (14, 2) ) 


Caly Re 2a ee do ee) 


EN ol tee) a OS O AO LES 


amount Of information transmitted for two S 


five sounds to five colors: 


I! 


I! 


ANS) + Hly) = A(X, Ve we p O oe = «3 09/9 


1552 Dits 


amount of equivocation: 


E MR OL AS 0579 5329s 
amount of noise: 
= H(y) - T(x,y) = 2.3- 1,53 = 0.77 bits 
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APPENDIX D 


EXPERIMENT INSTRUCTIONS 


The following instructions were Orally given to each S 
and corresponded to the different sessions involved in the 
experiment: Session 1 - Loudness matching; Session 2 - 
Brightness matching and Session 3 - Color-tone matoning- 
The instructions were brief in order to keep the S naive 
as to the ultimate purpose of the experiment. The instruc- 
tions in the following paragraphs are listed as they were 


u zsenredeto each S, i.e., in the first person. 


SESSION 1 — INSTRUCTIONS 

The first thing I want you to do is to press each white 
u on from top to bottom. Notice that each has a different 
tone and some tones are louder than others. I want you to 
concentrate on the loudness aspect. If you wish you can 
identify the buttons by number from top to bottom as one, 
two, three, four, and five. The top button is the refer- 
ence or standard tone. I will be outside the booth to make 
the necessary adjustments. You are to begin by alternately 
pressing buttons one and two as many times as you like, and 


" 


tell me to "increase (up)" or decrease (down)" the loudness 
level of button two to make it sound equally loud to button 
one. When you think the tones sound equal in loudness, 


just say "equal". After the first two sounds are adjusted 
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you are to go through the same matching process for buttons 
one and three, one and four, and one and five. Note: After 
the E reentered the booth, the S was instructed to press 
each button, one at a time, in any order, as a final check 
to ensure all buttons were equal in loudness. Also, the 


S was instructed to remember the sound of each tone. 


Be SESSION 2 - INSTRUCTIONS 

Prior to giving instructions to the S, the E turned on 
each light. Now what I want you to do is to adjust the 
brightness (intensity) level of each light so that each 
light appears equal in brightness to the blue light; the 
blut light is the reference light. You adjust the brightness 
Pavel Of each light by turning the black knob below each 
BNE. 

As a final check the S was asked if each light appeared 


equal in brightness to the blue light. 


Sec eoSo LON 3 - INSTRUCTIONS 

This is the last part of the experiment. I will turn 
On one light for about two seconds. While the light is on 
I want you to press a button that you feel should go with, 
or be matched with, the colored light. This matching should 
be done in whatever way Seems natural to you. I will turn 
off the light and then turn on another light. You are to 
respond by pressing another button. The lights will be 


shown in random order. There is no association between the 
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position of the buttons and the position of the lights. 

Do not worry about making mistakes; you will be shown each 
light several times and you may change your matching 
selection if you wish. But as you go along, you will 
learn to make consistent matching associations in which 
one different sound is matched to one different color. 
When I have seen that you have learned to do this, we will 


Stop. 
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APPENDIX E 


DATA APPENDIX 


Tables E-1 through E-4 (Data Appendix E) contain the 
frequency data of the color-tone matchings by trial for 
all subjects and by nationality. Each row corresponds to 
a stimulus color and each column corresponds to a response 
tone. The cell entries contain the frequencies (choices) 
associated with the color-tone matchings. The relative 
sample frequency is listed in parentheses below each fre- 
quency count. The row and column marginals correspond to 
the summation of each row and column respectively. The 
relative sample frequencies were used to calculate the 
quantities of information measures. The notation associated 
with each trial is explained as follows: Trial N was the 
second to last trial of the two consecutively matched 
trials. The last two trials contained the same frequencies. 
Trial N-1 was the trial preceding Trial N and Trials 
N-2(N-3) were the trials preceding Trials N-1(N-2) respec- 
tively. Trial N-4 contained the pooled cell frequencies 
Rom the number of trials greater than or equal to the 
fourth trial preceding Trial N. The information matrices 
for Trial N are listed in Tables 1 through 4 and have been 
previously discussed. The information matrices for trials 
N-4, N-3, N-2, and N-1 for all subjects and by nationality 


are listed in Tables E-1 through E-4. 
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The detailed information analysis is contained in 
Table E-5. The information measures are summarized by 
trial, by number of subjects per trial, for all subjects 
and by nationality. The information matrices indicated a 
general lack of consistency and perfect transmission in 
the presence of large amounts of noise and equivocation. 
The information measures provide a means of identifying 
learning trends in the color-tone niga Inspection 
Of the data for trials N-4 through N-l indicates that 
learning was non-existent. The Indonesian subjects had 
larger amounts of transmitted information per trial. In 
trials for the Korean subjects, the amount of trans- 
mitted information was less than .49 bits. 

Tables E-6 and E-7 contain the loudness level and 


photometric brightness data for all 50 subjects, respectively. 
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Table E-l 


Frequency of Color-Tone Matchings by Trial for All Subjects 


(Relative frequencies are shown in parentheses) 
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SOLO ES 
315 
Red T 
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Table E-1 Continued 


Tones 
750 1000 
Trial N-2 
n 2 
.0205) (.0103) 
10 ES 
EE (0615) 
ig 13 
.036) ( .065) 
T 2 
.036) (2020) 
5 10 
.026) os 
33 42 
AT) (.215) 
Trial Nel 
5 2 
022) (.008) 
9 15 
. Oh) ( .066) 
9 22 
. Oh ) (.097) 
15 4 
067 ) (ol 
ó 6 
.026) (.026) 
yd 19 


.195( (7219) 


1500 


er 


( .108) 


( .0h1) 

( .005) 
3 

[051529 


3 
‚0154) 


4T 


36 
( .185) 


eh 
(.106) 


LO 
(Old) 
(004) 
2 
(.008) 


ONT) 


41 
(.182) 


Row Sums 


37 
(.20) 


E 
(.20) 


(20) 


195 
(1) 


45 
(20) 


L5 
uo 


45 
(.20) 


45 
(20) 


45 
(.20) 


22 
(1) 





Table E-2 


Frequency of Color-Tone Matches by Trial for 25 U. S. Officers 


(Relative frequencies are shown in parentheses) 
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Table E-2 Continued 


"sors Tones Row Sums 
So 500 fee 1000 1500 
Trial N-2 
Red 3 il 2 l 13 20 
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MES 


Frequency of Color-Tone Matchings by Trial for the Indonesian Subjects 
(Relative frequencies are shown in parentheses) 
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Table E-3 Continued 
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Table FE.) 


Frequency of Color-Tone Matchings by Trial for the Korean Subjects 
(Relative frequencies are shown in parentheses) 





Colors Tones Row Sums 
EE 200 (150 1000 1500 

Red Y 2 3 5 11 25 
(0225) (7016) (.024) (.04) (.088) (.20) 

Yellow l LO h AES 2 25 
(.008) (.08) (.032) ( . 06h) (FOG) (.20) 

Orange 8 3 3 7 h 25 
( .06h) (.024) (.02h) (1050) (.032) (.20) 

Green 2 7 i 2 2 25 
(.016) (.056) (.096) (2026) (.016) (.20) 

Blue 10 3 3 h J E 
(.08) TAD ( .02h) (.032) ( . Oh ) (T20) 

(Column 

Sums ) 25 25 25 26 24 125 
(.20) (.20) (.20) (.208) (.192( (1) 

Trial N= 

Red 2 2 O 1 P 10 
(.04) mol) ( .00) (.02) BO (.20 

Yellow 2 3 h i O 10 
(.oh) (FOC) (.08) (055) . 00) (.20) 

Orange 2 h O h O LO 
MOL) (.08) (.00) (208) . 00) 20) 

Green i 2 2 h 1 10 
(De) (.04) ( Oh) (.08) .02) (.20) 

Blue 3 iL 2 2 2 10 
(.06) (.02) (.04) (.OL) Oh) (.20) 

(Column 

Sums) LO ie 8 re 8 50 
(.20) (.20) (.20) mo) 20) (1) 


143 





Colors 
Bo 
Red E 
( .0h) 
Yellow O 
200) 
Orange h 
(.08) 
Green dE 
402) 
pu e 
(.04) 
(Column 
Sums ) 9 
ES!) 
Red c 
(.04) 
Yellow 3 
(.06) 
Orange 3 
(.06) 
Green T 
(.02) 
Blue 2 
(.04) 
(Column 
Sums ) ti 
acc 


500 


Table E-h Continued 
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Table E-6 


Luudness Level Observations (in dB) for All Subjects fcr Each of Five 


Bub jects 


37 


500 


76 
78 
T9 
76 
60 
60 
60 
68 
61 
65 
po 
72 
68 
65 
63 
TO 
Tu 
Th 
TO 
Th 
TO 
e 
> 
70 
ah 
o 
We 


Frequencies 
(Reference Tone was 1500 Hz at 80 dB(SPL) 
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Table E-6 Continued 
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Table E-6 Continued 


1. The mean value of the distribution of the average loudness levels 


per frequency: 74.37 dB. 


2. The standard deviation of the distribution of the average loudness 


levels per frequency: 2.95 dB. 


EN Bhe mean value of the distribution of the standard deviation of 


loudness levels per frequency: 4.96 dB. 


h. The standard deviation of the distribution of the standard deviations 


of loudness level per frequency: 2.23 dB. 


5. The mean value for the distribution of each S's mean loudness level: 


fot dB. 


6. The standard deviation for the distribution of each S's mean loudness 
level: 3.89 dB. 


7. The mean value of the distribution of each S's standard deviation 


) 
loudness level: 4.74 4B. 


8. The ee deviation of the distribution of each S's standard 


deviation loudness level: 1.68 dB. 


149 





POBLE >? 


thotcmetric Brightness Cbservation (in foct-candles) fcr All Subjects for 
Each of Five Colors 
(Reference Color was Blue) 


Subjects Colors Mean Standard 
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Table E-7 Continued 
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Table E-T Continued 


1. The mean value of the distribution of the average brightness levels 


per color: 3.46 fc. 


2. The standard deviation of the distribution of the average brightness 


levels per color: 2.49 fe. 


3. The mean value of the distribution of the standard deviation of 


Brightness levels per color: 2.32 fc. 


h. The standard deviation of the distribution of the standard deviations 


seEbrozhtness Levels per color: 2.30 fc. 


5. The mean value for the distribution of each S's mean brightness level: 
aa fe. 


6. The standard deviation for the distribution of each S's mean bright- 
ness level: 1.74 fe. 


7. The mean value of the distribution of each S's standard deviation 


brightness level: 2.16.fc. 


| | — ` — — — .-— == 


8 The standard deviation of the distribution of each S's standard 


we 


deviation brightness level: 2.38 fe. 


-— — — ww 
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